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Abstract. The semimartingale stochastic approximation procedure, na- 
mely, the Robbins-Monro type SDE is introduced which naturally includes 
both generalized stochastic approximation algorithms with martingale no- 
ises and recursive parameter estimation procedures for statistical models 
associated with semimartingales. General results concerning the asymp- 
totic behaviour of the solution are presented. In particular, the conditions 
ensuring the convergence, rate of convergence and asymptotic expansion 
are established. The results concerning the Polyak weighted averaging pro- 
cedure are also presented. 
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0. Introduction 



In 1951 in the famous paper of H. Robbins and S. Monro "Stochastic approx- 
imation method" [3E] a method was created to address the problem of location 
of roots of functions, which can only be observed with random errors. In fact, 
they carried in the classical Newton's method a "stochastic" component. 

This method is known in probability theory as the Robbins-Monro (RM) 
stochastic approximation algorithm (procedure). 

Since then, a considerable amount of works has been done to relax assump- 
tions on the regression functions, on the structure of the measurement errors 
as well (see, e.g., pi], [22], [26], [27], [28], [29], [30], @T], 02]). In particular, 
in [2E] by A. V. Melnikov the generalized stochastic approximation algorithms 
with deterministic regression functions and martingale noises (do not depend- 
ing on the phase variable) as the strong solutions of semimartingale SDEs were 
introduced. 

Beginning from the paper [1] of A. Albert and L. Gardner a link between 
RM stochastic approximation algorithm and recursive parameter estimation 
procedures was intensively exploited. Later on recursive parameter estimation 
procedures for various special models (e.g., i.i.d models, non i.i.d. models in 
discrete time, diffusion models etc.) have been studied by a number of authors 
using methods of stochastic approximation (see, e.g., [7J, [TZ], [23], [25], [2"7j . 
[3B], [32], [ID]). It would be mentioned the fundamental book [32] by M. B. 
Nevelson and R.Z. Khas'minski (1972) between them. 

In 1987 by N. Lazrieva and T. Toronjadze an heuristic algorithm of a con- 
struction of the recursive parameter estimation procedures for statistical mod- 
els associated with semimartingales (including both discrete and continuous 
time semimartingale statistical models) was proposed [18]. These procedures 
could not be covered by the generalized stochastic approximation algorithm 
proposed by Melnikov, while in i.i.d. case the classical RM algorithm contains 
recursive estimation procedures. 

To recover the link between the stochastic approximation and recursive pa- 
rameter estimation in [T9] . [20] . [21] by Lazrieva, Sharia and Toronjadze the 
semimartingale stochastic differential equation was introduced, which natu- 
rally includes both generalized RM stochastic approximation algorithms with 
martingale noises and recursive parameter estimation procedures for semi- 
martingale statistical models. 

Let on the stochastic basis (fi,jF, F = (jF t ) 4 > ,P) satisfying the usual con- 
ditions the following objects be given: 
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a) the random field H = {H t (u), t > 0, u G R 1 } = {H t (u,u), t > 0, uo G 
fl,iiG R 1 } such that for each u G R 1 the process H(u) = (H t (u)) t > G 
V (i.e. is predictable); 

b) the random field M = {M(t,u), t > 0, u G R 1 } = {M(u,t,u), u G 
Q, t > 0, u G R 1 } such that for each u G R 1 the process M(u) = 
(M(t,u)) t > eMl c (P); 

c) the predictable increasing process K = (K t )t>o (i-e. if G V + HP). 

In the sequel we restrict ourselves to the consideration of the following par- 
ticular cases: 

1°. M(u) =me Ml c (P); 

2°. for each u E R 1 M{u) = f(u) ■ m + g(u) ■ n, where m G A4\ oc (P), 
n G Mff c (P), the processes f(u) = (f(t,u)) t > and g(u) = (g(t,u)) t >o 
are predictable, the corresponding stochastic integrals are well-defined 
and M(u) G Ml c {P); 

3°. for each u E R 1 M(u) = tp(u)-m + W(u) * (fi — u), where m G M\ oc (P), 
fi is an integer- valued random measure on (R x E, B(R + ) x e), v is its P- 
compensator, (E, e) is the Blackwell space, W{u) = (W(t,x, u), t>0, 
x G E) G V <S> s. Here we also mean that all stochastic integrals are 
well-defined. 

t 

Later on by the symbol J M(ds,u s ), where u = (u t )t>o is some predictable 

o 

process, we denote the following stochastic line integrals: 

t t 
J f(s,u s )dm s + J g(s,u s )dn s (in case 2°) 
o o 

or 

t t 



cp(s, u s ) dm s + J J W(s, x,u s )(u — u)(ds, dx) (in case 3°) 

E 

provided the latters are well-defined. 

Consider the following semimartingale stochastic differential equation 

t t 

z t = z + / H s (z s _) dK s + / M{ds, z a -), z G Jo- (0.1) 



We call SDE (JQHJ) the Robbins-Monro (PM) type SDE if the drift coefficient 
Ht(u), t > 0, u G R 1 satisfies the following conditions: for all t G [0, oo) P-a.s. 

H t (0) = 0, 

(A) 

K 1 H t (u)u < for all u + 0. 

The question of strong solvability of SDE (10. ip is well- investigated (see, e.g., 

is], ®, m)- 
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We assume that there exists an unique strong solution z = (z t ) t > of equation 
(10.11) on the whole time interval [0, oo) and such that M e Aif oc (P), where 

t 

M t = J M(ds,z s -). 
o 

Some sufficient conditions for the latter can be found in [8], [9], |13j . 

The unique solution z = (z t )t>o of RM type SDE (10. 11 can be viewed as a 
semimartingale stochastic approximation procedure. 

In the present work we are concerning with the asymptotic behaviour of the 
process (z t )t>o and also of the averized procedure z = o e) (see Section 3 
for the definition of z) as t — > oo. 

The work is organized as follows: 

In Section 1 we study the problem of convergence 

z t —>■ as t — > oo P-a.s. (0-2) 

Our approach to this problem is based, at first, on the description of the non- 
negative semimartingale convergence sets given in subsection 1.1 [19] (see also 
[T9"] for other references) and, at the second, on two representations "standard" 
and "nonstandard" of the predictable process A = (A t ) t > in the canonical 
decomposition of the semimartingale (z 2 ) t >o, z 2 = A t + mart, in the form 
of difference of two predictable increasing processes A 1 and A 2 . According 
to these representations two groups of conditions (I) and (II) ensuring the 
convergence (10. 2p are introduced. 

in subsection 1.2 the main theorem concerning (10.21) is formulated. Also the 
relationship between groups (I) and (II) are investigated. In subsection 1.3 
some simple conditions for (I) and (II) are given. 

In subsection 1.4 the series of examples illustrating the efficience of all as- 
pects of our approach are given. In particular, we introduced in Example 
1 the recursive parameter estimation procedure for semimartingale statistical 
models and showed how can it be reduced to the SDE (10.11) . In Example 2 
we show that the recursive parameter estimation procedure for discrete time 
general statistical models can also be embedded in stochastic approximation 
procedure given by (10.11) . This procedure was studied in [39] in a full capacity. 

In Example 3 we demonstrate that the generalized stochastic approximation 
algorithm proposed in [2E] is covered by SDE (10.11) . 

In Section 2 we establish the rate of convergence (see subsection 2.2) and 
also show that under very mild conditions the process z = (z t )t>o admits an 
asymptotic representation where the main term is a normed locally square 
integrable martingale. In the context of the parametric statistical estimation 
this implies the local asymptotic linearity of the corresponding recursive esti- 
mator. This result enables one to study the asymptotic behaviour of process 
z = (zj)t>o using a suitable form of the Central limit theorem for martingales 
(see RefsT [UJ, H3, H3, [25], M- 
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In subsection 2.1 we introduce some notations and present the normed pro- 
cess y^z 2 in form 

^ = 77^71 + (°- 3 ) 

where L = (L t )t>o E A4f oc (P) and (L) t is the shifted square characteristic of 
L, i.e. (L) t := 1 + (L)f' P . See also subsection 2.1 for the definition of all 
objects presented in f |Q.3j) . 

In subsection 2.2 assuming z t — > as t — > oo P-a.s., we give various sufficient 
conditions to ensure the convergence 

~{ s t zl -> as t -> oo (P-a.s.) (0.4) 

for all 5, < 8 < 5 , where 7 = (7t)t>o is a predictable increasing process 
and So, < do < 1, is some constant. In this subsection we also give series if 
examples illustrating these results. 

In subsection 2.3 assuming that Eq. (10.41) holds with the process asymptoti- 
cally equivalent to x 2 ; we study sufficient conditions to ensure the convergence 

as t -> 00 (0.5) 

which implies the local asymptotic linearity of recursive procedure z = (z t )t>o- 
As an example illustrating the efficience of introduced conditions we consider 
RM stochastic approximation procedure with slowly varying gains (see [3T]). 

An important approach to stochastic approximation problems has been pro- 
posed by Polyak in 1990 [33] and Ruppert in 1988 [38]. The main idea of this 
approach is the use of averaging iterates obtained from primary schemes. Since 
then the averaging procedures were studied by a number of authors for various 
schemes of stochastic approximation (pQ, [2], [3], [1], [5], [6], [7], [31], [31]). The 
most important results of these studies is that the averaging procedures lead 
to the asymptotically optimal estimates, and in some cases, they converges to 
the limit faster than the initial algorithms. 

In Section 3 the Polyak weighted averaging procedures of the initial process 
z = (zt)t>o are considered. They are defined as 



t 

Et l {goK) J z s de s {goK) 



z t = e;\g o K) / z s de s {g o K), (0.6) 



where g = (gt)t>o is a predictable process, g t > 0, J g s dK s < 00, J gtdK t = 00 



and St(X) as usual is the Dolean exponential. 

Here the conditions are stated which guarantee the asymptotic normally of 
process z = (zt)t>o i n cas e of continuous process under consideration. 

The main result of this section is presented in Theorem 3.3.1, where as- 
suming that Eq. (10.41) holds true with some increasing process 7 = (jt)t>o 
asymptotically equivalent to the process (r^ (L) < " 1 )t>o the conditions are given 
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that ensure the convergence 

e} /2 z t ^V2Z, £gA(0,1), (0.7) 

where e t = 1 + j T 2 (L); l f3 s dK s . 
o 

As special cases we have obtained the results concerning averaging proce- 
dures for standard RM stochastic approximation algorithms and those with 
slowly varying gains. 

All notations and fact concerning the martingale theory used in the pre- 
sented work can be found in [12], [14], |25j . 



I. Convergence 

1.1. The semimartingales convergence sets. Let (Q,,T,F = (jF t ) t > ,P) 
be a stochastic basis satisfying the usual conditions, and let A = (X t ) t > 
be an F-adapted process with trajectories in Skorokhod space D (notation 
X = F n D). Let = lim X t and let {X — ►} denote the set, where X^ 

t^oo 

exists and is a finite random variable (r.v.). 

In this section we study the structure of the set {X — >} for nonnegative 
special semimartingale X. Our approach is based on the multiplicative de- 
composition of the positive semimartingales. 

Denote V + (V) the set of processes A = (A t ) t > , A = 0, A G F n D 
with nondecreasing (bounded variation on each interval [0,t[) trajectories. We 
write X G V if X is a predictable process. Denote Sp the class of special 
semimartingales, i.e. X G S p if X G F fl D and 

X = X + A + M, 

where A G V n V, M G A^i oc . 

Let A G Sp. Denote e(X) the solution of the Dolean equation 

Y = 1 + Y- ■ A, 

i 

where F_ • A t := / Y s ^dX s . 
o 

If Ti, T 2 G JF, then Ti = T 2 (P-a.s.) or r a C T 2 (P-a.s.) means P(LiAr 2 ) = 
or P(Ti R (p, \ r 2 )) = respectively, where A is the sign of the symmetric 
difference of sets. 

Let A G S P . Put A = A 1 - A 2 , where A 1 ,A 2 eV + n V. Denote 

A — (1 + A_ + A 2 r 1 o A 2 ^ := ^(1 + A s _ + A 2 _)-MA^ . 
Theorem 1.1.1. Let X G S P , X > 0. T/ien 



{loo < oo} C {A -} n {Ale < oo} (P-a.s.). 
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Proof. Consider the process Y = 1 + X + A 2 . Then 

Y = Y Q + A 1 + M, Y = 1 + X 0j 

Y > 1, 3C 1 AA 1 > 0. Thus the processes A = Yl 1 o A 1 and M = (Yl + 

AA 1 )- 1 ■ M are well-defined and besides A G V+ n V, M G M\ oc . Then, 
using Theorem 1, §5, Ch. 2 from [25] we get the following multiplicative 
decomposition 

Y = Y e(A)e(M), 

where e(A) G V+ n P, e(M) G M Xoc . 

Note that AM > -1. Indeed, AM = (K_ + AA^AM. But AM = 
AF - AA 1 = y - (K. + AA 1 ) > -(y_ + AA 1 ). Therefore e(M) > and 
{s(M) — >} = Q (P-a.s.). On the other hand (see, e.g., [30], Lemma 2.5) 

e t (A) | oo •<=>■ A t | oo as £ — > oo. 

Hence 

{Aoo < oo} c {y ^} = {x ^} n {A^ < oo}, 

since A 2 < Y and A 2 G V + . 

Theorem is proved. □ 

Corollary 1.1.1. 

{Al < oo} = {(1 + X_)- x o Al < oo} = < oo} (P-a.s.). 
Proof. It is evident that 

{Al < oo} C {(1 + X_)^ o A^ < oo} C {A^ < oo} 
C {X ->} n < oo} (P-a.s.). 

It remains to note that 

{Al < oo} n {X ^} n {A^ < oo} 

= {loo < oo} n {X ^} n {A^ < oo} (P-a.s.). 
Corollary is proved. □ 
Corollary 1.1.2. 

{loo < oo} n {£oo(M) > 0} = {X ^} n {Al < oo} n {£oo(M) > 0} (P-a.s.), 

as it easily follows from the proof of Theorem 

Remark 1.1.1. The relation 

{Al < 00} C {X ^} n {Al < 00} (P-a.s.) 

has been proved in [25J, Ch. 2, §6, Th. 7. Under the following additional 
assumptions: 

1. EX < 00; 

2. one of the following conditions (a) or are satisfied: 
(a) there exists e > such that A\ +£ G T t for all £ > 0, 
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{(3) for any predictable Markov moment a 

EAAll w<oo} < oo. 

Let A,BeFH D. We write A ~< B ii B — A eV + . 

Corollary 1.1.3. Let X e S P , X > 0, A < A 1 - A 2 and A -< A 1 , where 
A 1 , A 2 eV + HV. Then 

i A lc < oo} = {(1 + X^)- 1 o Al < oo} C {X ^} n {Al < oo} (P-a.s.). 

Proof. Rewrite X in the form 

X = X + A 1 - A 2 + M, 

where A 2 = A 1 — A 6 V 1 C\V. Then the desirable follows from Theorem 11.1. 11 
Corollary 1 1 . 1 . 1 1 and trivial inclusion {A 2 ^ < oo} C {A 2 ^ < oo}. 

The corollary is proved. □ 

Corollary 1.1.4. Let X e S P , X > and 

X = X + X_o B + A + M 

with B e V + n V, A e V n V and M e Mio C . 
Suppose that for A 1 ,A 2 eV + (~)V 

A<A X -A 2 and A -< A 1 . 

Then 

{A 1 ^ < oo} n {5oc < oo} C {X ^} n {Ale < oo} (P-a.s.). 

The proof is quite similar to the prof of Corollary 11.1.31 if we consider the 
process Xe~ l (B). 

Remark 1.1.2. Consider the discrete time case. 

Let JF , . . . be a non- decreasing sequence of cr-algebras and X n , /3 n , £ n , 
Cn ^ n > 0, are nonnegative r.v. and 

n 

X n = X + Y, X-iA-i + A n + M n 

i=0 

(we mean that X-\ = Xq, T-\ = T§ and /3_i = £_i = C-i = 0), where A n e 
T n -\ with Aq = and M e -Mi oc . Note that X n can always be represented in 

n n 

this form taking A n = J2(E(X i \J r i ^i) ~ X-i) - Yj -^i-iA-i- 

i=0 i=0 

Denote 

n n 

4i = Z}6-i and ^ = ^C-i- 

j=0 i=0 

It is clear that in this case 

A -< A 1 <*=> AA n < e n -i 

(AA n := A n - A n _ 1; n > 1) . 

So, in this case Corollary 11.1.41 can be formulated in the following way: 



a.s. 
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Let for each n 

n 

A n < - Ci-l) 

i=0 

and 
Then 

| J^^-i <oo n < oo I c {X ^}n | J^Ci-i < oo Up- 

^ i=0 ' ^ i=0 ' ^ i=0 ' 

From this corollary follows the result by Robbins and Siegmund (see Rob- 
bins, Siegmund [37]). Really, the above inclusion holds if in particular AA n < 
Cn-i - Cn-i, n > 1, i.e. when 

E{X n | F n - X ) < X n _i(l + /3 n _i) + ^ n _! - Cn-i, n > 0. 

In our terms the previous inequality means A ~< A 1 — A 2 . 

1.2. Main theorem. Consider the stochastic equation (RM procedure) 

t t 
z t = z + [ H s {z s ^) dK s + / M(ds,z s _), £ > 0, z E F , (1.2.1) 



or in the differential form 

dz t = H t (z t -)dK t + M(dt, z t -), z e 

Assume that there exists an unique strong solution z = (z t ) t > of (jl.2.ip on 
the whole time interval [0, oo), M G M.f oc , where 

t 

M t := I M(ds,z s _). 



We study the problem of P-a.s. convergence z t — > 0, as t — > oo. 
For this purpose apply Theorem II .1.11 to the semimartingale X t = z 2 , t > 0. 
Using the Ito formula we get for the process (zf )t>o 

dz\ = dA t + dN t , (1.2.2) 

where 

dA t = V t -(zt-)dK t + V t + (z t -)dK? + d(M) t , 

dN t = 2z t -dM t + H t (zt-)AK t dM d t + d([M] t - (M)t), 

with 

V t ~(u) := 2H t (u)u, 
V t + (u) := Ht(u)AK t . 
Note that A = (A t ) t >o G V n V, N e M\ oc . 



(2) 
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Represent the process A in the form 

A t = A] - A 2 (1.2.3) 

with 

f dAi = Y+MdK* + d(M) t , 

1 ] \ -dA 2 t =V t -(z t _)dK t , 
or 

dA\ = [V t -(z t ^)I {AKtm + V t + M\ + dK? + d{M) u 
-dA\ = {V t -(z t _)I {AKt=0} - [Vf(z t „)I {AKtm + V+(z t _)]-}dK t , 

where [a} + = max(0,a), [a] - = — min(0, a). 

As it follows from condition (A) a t (z t _) < for all t > and so, the represen- 
tation (11.2.31) (1) directly corresponds to the usual (in stochastic approximation 
procedures) standard form of process A (in (11.2.21) A = A 1 — A 2 with A 1 , A 2 
from (ll.2.3p (l)). Therefore we call representation fl 1 . 2 . 3 [) ( 1 ) "standard", while 
the representation (1 1 . 2 . 3 [) ( 2 ) is called "nonstandard". 

Introduce the following group of conditions: For all u G R 1 and t G [0, oo) 

(A) For all t G [0, oo) P-a.s. 
H t (0) = 0, 

H t (0)u < for all u ^ 0; 

(B) 

(i) (M(u)) « K, 

(ii) ht{u) < B t {l + it 2 ) , B t > 0, B = {B t ) t > e V, B o < oo, 
where h t (u) = 

(I) 

(i) («i) I { AK tm \H t (u)\ < C t (l + \u\), C t >0, C = (C t ) t > eV, CoK t <oo, 
(i 2 ) C 2 AK oKi<oo, 

(ii) for each e > 

inf |V _ (m)| o Kqo = oo: 

e<H<l/e 

(II) 

(i) [V t -(u)I {AKtm + V t + (u)}+ < A(l + u 2 ), D t > 0, 
D = (D t ) t > eV,DoKi<oo, 

(ii) for each e > 

inf {|y-(u)|I { A* t =o} + r(«)Wl + V+ ( U T} ° J ^oo = oo. 

Remark 1.2.1. When M(w) = m G .Mf oc , we do not require the condition 
(m) <C K and replace the condition (B) by 

(B') (m)oo < oo. 



Remark 1.2.2. Everywhere we assume that all conditions are satisfied P-a.s. 
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Remark 1.2.3. It is evident that (I) (ii)=> C o = oo. 

Theorem 1.2.1. Let conditions (A), (B), (I) or (A), (B), (II) be satisfied. 
Then 

z t — > P-a.s. as t — > oo. 

Proof. Assume, for example, that the conditions (A), (B) and (I) are satisfied. 
Then by virtue of Corollary II. 1.11 and (jl.2.2p with standard representation 
( II. 2. 31) (1) of process A we get 

{(1 + zi)- 1 o Al < oo} C {z 2 -} n {^L < oo}. (1.2.4) 

But from conditions (B) and (I) (i) we have 

{(1 + zi)- 1 oA 1 OQ <oo} = n (P-a.s.) 

and so 

{z 2 ^}n{A 2 00 <oo} = n (P-a.s.). (1.2.5) 

Denote z 2 ^ = lim z 2 , N = {z 2 ^ > 0} and assume that P(N) > 0. In this case 

t— >oo 

from (I) (ii) by simple arguments we get 

P(\V-(z^)\oK oo = oo)>0, 

which contradicts with (11.2.4)1 . Hence P(N) = 0. 
The proof of the second case is quite similar. 

The theorem is proved. □ 

In the following propositions the relationship between conditions (I) and (II) 
are given. 

Proposition 1.2.1. (I)=^(II). 

Proof. From (I) (ii) we have 

[V t -(u)I {AKtm + V t + (u)] + < V+(u) < C 2 AK t (l + u 2 ) 

and if take D t = C?AK t , then (II) (i) follows from (I) (z 2 ). 

Further, from (I) (i\) we have for each e > and u with e < \u\ < 1/s 

\V t '(u)\I {AKt=0} + [V t -(u) + V t + (u)]-I {AKtm 

> \V t -(u)\ - V t + (u) > \V t -(u)\ - C 2 AK t (l + 1). 

Now (II) (ii) follows from (I) (12) and (I) (ii). 

The proposition is proved. □ 

Proposition 1.2.2. Under (I) (i) we have (I) (ii) <^> (II) (ii). 

Proof immediately follows from previous proposition and trivial implication 

(ii) (ii)=Ki) (ii). 
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1.3. Some simple sufficient conditions for (I) and (II). Introduce the 
following group of conditions: for each u E R 1 and t G [0, oo) 

(S.l) 

(i) (k) G t \u\ < \H t (u)\ < G t \u\, G t >0, G= (G t ) t >o, 

G = (G t ) t > eV, GoK t <oo, 

(i 2 ) G 2 AKoK d OQ < oo; 

(ii) Go #^ = 00; (1.3.1) 

(S.2) 

(i) G[-2 + GAK}+ o < 00; (1.3.2) 

(ii) G{2I {AK=0} + [-2 + GAK\-I {AK¥0} 0^ = 00. (1.3.3) 
Proposition 1.3.1. 

(S.l) =► (I), 
(S-l)(»i), (S.2) =► (II). 
Proof. The first implication is evident. For the second, note that 
V t -(u)I {AKtm + V+(u) = -2\H t (u)\ \u\I {AKtm + H?(u)AK t 

< \H t (u)\ \u\ [-2I {AKtm + G t AK t }. (1.3.4) 

So 

[V t -(u)I {AKtm + V+(u)} + < \H t {u)\ \u\ i-2I {AKtm + G t AK t }+ 

<G t [-2I {AKim + G t AK t } + \u 2 \ 

and (II) (i) follows from fll.3.2p if we take 

D t = G t [-2 + G t AK t ] + I {AKtm . 

Further, from (11.3.4j) we have 

\V t -(u)\I {AKt=0} + [V t -(u)I {AKtm + V t + (u)]- 

> u 2 G t {2I {AKt=0} + \-2I {AKt ^ } + G t AK t ]~} 

and (II) (ii) follows from (PUD . 

Proposition is proved. □ 

Remark 1.3.1. 

a) (S.1)=KS.2), 

b) under (S.l) (i) we have (S.l) (ii)^(S.2) (ii), 

c) (S.2) (ii)=KS.l) (ii)- 

Summarizing the above we come to the following conclusions: a) if the 
condition (S.l) (ii) is not satisfied, then (S.2) (ii) is not satisfied also; b) if (S.l) 
(ii) and (S.l) (ii) are satisfied, but (S.l) (i 2 ) is violated, then nevertheless the 
conditions (S.2) (i) and (S.2) (ii) can be satisfied. 
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In this case the nonstandard representations ( 11. 2. 31) (2) is useful. 

Remark 1.3.2. Denote 

G t AK t = 2 + 5 t , 5 t > -2 for all t E [0, oo). 

It is obvious that if 5 t < for all t G [0, oo), then [-2 + G t AK t ] + = 0. So (S.2) 
(i) is trivially satisfied and (S.2) (ii) takes the form 

C{2I{A*r=o} + \S\I{ak^o} o i^oo = oo. (1.3.5) 

Note that if G ■ min(2, \5\) o fCx> = oo, then (11.3.51) holds, and the simplest 
sufficient condition (11.3.51) is: for all t > 

G o Koq = oo, \5t\ > const > 0. 

Remark 1.3.3. Let the conditions (A), (B) and (I) be satisfied. Since we apply 
Theorem II. 1.11 and its Corollaries on the semimartingales convergence sets 
given in subsection 11.11 we get rid of many of "usual" restrictions: "moment" 
restrictions, boundedness of regression function, etc. 

1.4. Examples. 

1.4.1. Recursive parameter estimation procedures for statistical models associ- 
ated with semimartingale. 

1. Basic model and regularity. Our object of consideration is a parametric 
filtered statistical model 

e=(n,r,W={F t ) t >a,{P ;eeR}) 

associated with one-dimensional F-adapted RCLL process X = (X t ) t > in 
the following way: for each 9 6 R 1 Pg is an unique measure on (Q, T) such 
that under this measure X is a semimartingale with predictable character- 
istics (B(9),C(9),Vg) (w.r.t. standard truncation function h(x) = xln x \<xy). 
Assume for simplicity that all Pg coincide on JF . 

Suppose that for each pair {9, 9') Pg ~ P g ,. Fix 9 = and denote P = P , 
B = 5(0), C = C(0), v = u . 

Let p(9) = (pt(0))t>o be a local density process (likelihood ratio process) 

(a\ dPe,t 
Pt{e) = lip' 

where for each 9 P e t := Pg\P t , Pt '■= P\Pt are restrictions of measures Pg and 
P on Tti respectively. 

As it is well-known (see, e.g., [14J, Ch. Ill, §3d, Th. 3.24) for each 9 there 
exists a "P-measurable positive function 

Y(9) = {Y(co, t, x; 9), (to, t,x) ettx R + x R}, 

and a predicable process (3(9) = (Pt(@))t>o with 

\h(Y(9) - 1)| * v e A+ C (P), p 2 (9) o c e A+ C (P), 
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and such that 

(1) B(9) = B + ft(9)oC + h(Y(9)-l)*v, 

(2) C{6) = C, (3) v 6 = Y{6) -v. [ ' ' ] 
In addition the function Y(9) can be chosen in such a way that 

a t := u{{t}, R) = l^ at{6) := u $ ({t}, R) = Y(t, x; 9)v({t})dx = 1. 



We assume that the model is regular in the Jacod sense (see ^5\, §3, Df. 
3.12) at each point 9, that is the process {pe 1 / Pe) 1 ^ 2 is locally differentiable 
w.r.t 9' at 9 with the derivative process 

HO) = (L t (9))t>o e Ml c {P e ). 

In this case the Fisher information process is defined as 

T t (9) = (L(9),L(9)) t . (1.4.2) 

In [15] (see §2-c, Th. 2.28) was proved that the regularity of the model at 
point 9 is equivalent to the differentiability of characteristics ft (9), Y{9), a{9) 
in the following sense: there exist a predictable process ft (6) and P-measurable 
function W(9) with 

ft 2 (9) oC t <oo, W 2 (9) * u 0tt < oo for all t G R + 

and such that for all t G -R+ we have as 9' — > 9 

(1) (ft(9') - ft{9) - ft{9){9' - 9)f o C t /{9' - 9f 3 0, 

2 

2 ^fl 



(2) 



(3) E 



s<t 
a s (0)<l 



(I - a s {9')f/ 2 - {I - a s {9)) 112 



1.4.3) 



+ 1 



n 2 

(ff-Bf ^0, 



2 (i - o.(e)) 1 / 2 v 

where 

W?(0)= / W(t,x;0H({t},dx) 



In this case a s {9) = 1 =>- W®{9) = and the process L{9) can be written as 

L{9) = ft{9) ■ (X c - ft{9) o C) + (w e {9) + ^|y) * (a* - (1-4-4) 
and 

1(0) = /3 2 (£) o G + (^ e W) 2 * i/ + J2 V^WY ( L45 ) 
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Denote 



W e {9) 

$(0) = w{6) + 



1 - a(9) ' 

One can consider the another alternative definition of the regularity of the 
model (see, e.g., |35j) based on the following representation of the process p{6): 

p(9)=s(M(9)), 

where 

M(9) =P(9)-X c +(Y(9)-l + Y ^[~ a i {0<a<1} y( f i-u) eM loc (P)- (1-4.6) 



Here X c is a continuous martingale part of X under measure P (see, e.g., |16j . 
[28]). 

We say that the model is regular if for almost all (u,t,x) the functions 
P : 6 —* (3 t (cu;9) and Y : 9 — > F(w, t, a;; 0) are differentiable (notation 0(9) := 
jLf3(9), Y(9) := jLY(9)) and differentiability under integral sign is possible. 
Then 

^ \np(9) = L(M(9),M(9)) := 1(9) G -Mioc(^), 

where L(m, M) is the Girsanov transformation defined as follows: if m, M G 
Moc(-P) and Q < P with g = e(M), then 

L(m, M) := m — (1 + AM)" 1 o [m, M] G Moc(<5)- 

It is not hard to verify that 

1(9) = 0(9) ■ (X c - (5(9) o C) + £(0) * (// - (1.4.7) 

where 

5(9) = M + *w 



Y(0) l-a(0) 
with /{ a (e )= i}a(6 l ) = 0. 

If we assume that for each 9 G R 1 L(9) G A4f oc (Pg), then the Fisher infor- 
mation process is 

T t (9) = (L(9),L(9)) t . 

It should be noticed that from the regularity of the model in the Jacod sense 
it follows that L(9) G AAf oc (Pg), while under the latter regularity conditions 
L(9) G M.f oc (Po) is an assumption, in general. 

In the sequel we assume that the model is regular in both above given senses. 
Then 

W (° ) = Y§j> W°V) = W)> L(9) = L(0)- 
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2. Recursive estimation procedure for MLE. In [18] an heuristic algorithm was 
proposed for the construction of recursive estimators of unknown parameter 9 
asymptotically equivalent to the maximum likelihood estimator (MLE). 

This algorithm was derived using the following reasons: 

Consider the MLE 9 = (9t)t>o, where 9% is a solution of estimational equa- 
tion 

L t {9) = 0. 

Assume that 

1) for each 9&R 1 the process (It(9)) 1 ^ 2 (9 t —9) is Pg-stochastically bounded 
and, in addition, the process (9 t )t>o is a Pe-semimartingale; 

2) for each pair (9', 9) the process L(9') G M.\ oc (Po') an d is a P^-special 
semimartingale; 

3) the family (L(6), 9 G R 1 ) is such that the Ito-Ventzel formula is appli- 
cable to the process (L(t,9 t ))t>o w.r.t. Pg for each 9 G R 1 ; 

4) for each 9 G R 1 there exists a positive increasing predictable process 
(lt(9))t>o asymptotically equivalent to 1^(9), i.e. 

7t(0)£(0) ^ 1 as t -> oo. 

Under these assumptions using the Ito-Ventzel formula for the process 
(L(t,9 t ))t>o we get an "implicit" stochastic equation for 9 = {9 t )t>o- Ana- 
lyzing the orders of infinitesimality of terms of this equation and rejecting the 
high order terms we get the following SDE (recursive procedure) 

d9 t = lt (9 t _)L(dt,9 t _), (1.4.8) 

where L(dt,u t ) is a stochastic line integral w.r.t. the family {L(t,u), u G R 1 , 
t G R + } of Pg-special semimartingales along the predictable curve u = (u t )t>o- 
To give an explicit form to the SDE (11. 4. 81) for the statistical model asso- 
ciated with the semimartingale X assume for a moment that for each (u, 9) 
(including the case u = 9) 

|$(«)|*/iG AtJPo). (1-4.9) 
Then for each pair (u, 9) we have 

/ Y(u)\ 

$(u) v u ) = $(u) *{fi- v e ) + ${u) 1 - -77^- * V0. 



Y(9)J 

Based on this equality one can obtain the canonical decomposition of Pg- 
special semimartingale L(u) (w.r.t. measure Pg): 

L{u) = P(u) o (X c - /3(9) o C) + $(«) * (/i - v e ) 

+ $(u)W) - P(u)) o C + (l - ^\ * Vg. (1.4.10) 
Now, using (11.4. 10p the meaning of L(dt,u t ) is 
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t 



J L(ds,u s _) = J f3 s (u s „)d(X c -(3(6)°C), 



t 




+ / / $(s,x,u a -.)(/i-v g )(ds,dx)+ $,(u a )(p a (0) - /3 8 (u a ))dC, 







Y ( s x u _ 

+ 1 I ${s,x,u a -)[ 1 ' ^ ' )v (ds,dx). 




Finally, the recursive SDE (11.4. 8p takes the form 



0t = 0o+ I is{e s -)Ps{9 s -)d{X c - (3(6) o C) s 

1 a (9 a -)$(s,x,9 a J)(n - u e )(ds,dx) 





t 






t 



+ J la (6)(3 s {6 s ){p s (6) - p s (9 s ))dC s 
o 

Y(s,x,e a j 



+ J J i a (9 a -)$(s, x, 6 S _) (1 - ^ ' ^ 1 ^(ds, tte). (1.4.11) 
o 

Remark 1.4.1. One can give more accurate than f 1 1 . 4 . 9 j) sufficient conditions 
(see, e.g., [12], [Hj, [25J) to ensure the validity of decomposition (11.4. 10|) . 

Assume that there exists an unique strong solution (9 t )t>o of the SDE 
(1TXTTJ) . 

To investigate the asymptotic properties of recursive estimators [9 t )t>o as 
t — > oo, namely, a strong consistency, rate of convergence and asymptotic 
expansion we reduce the SDE (11.4.111) to the Robbins-Monro type SDE. 

For this aim denote z t = 9 t — 9. Then (11.4.111) can be rewritten as 

t 

z t = z + J ls (6 + z s _)$(6 + z.-)(p s (6) - (3 S (6 + z s .)dC s 
o 

t 

+ [ [ ls (d + z s ^(s, x, e + z s _) (i - Y{ t x / e+ n 2 : s - ) ) Mds, dx) 



Y(s,x } 6) 

+ / ls(9 + z s )f3 s {6 + z s )d(X c - (3(6) o C% 



o 

t 



18 N. LAZRIEVA, T. SHARIA AND T. TORONJADZE 

t 

+ J J \s(0 + Zs-)Q(s,x,d + z a -.)(ji-v )(ds,dx). (1.4.12) 
o 

For the definition of the objects K 6 , {H B {u), u G R 1 } and {M e (u), u G R 1 } 
we consider such a version of characteristics (C, vg) that 

C t = C e oA e t , 
u e (u, dt, dx) = dA e t B^ t (dx), 

where A e = {A 6 t ) t >o G A^ oc (Po), C 6 = (Cf) t >o is a nonnegative predictable 
process, and B^ t (dx) is a transition kernel from (fl x R + , V) in (R, B(R)) with 

<t({0}) = and 

(see [H], Ch. 2, §2, Prop. 2.9). 
' Put Kl = A°, 

H e t {u) = lt {9 + u) + u)((3 t (9) - foe + u))C e t 

+ J 4>(t, x,9 + u)(l- Y y£l* e) U) ) KAdx) } , (1.4.13) 
t 

M e (t, u) = I j s (9 + u)(3 s {9 + u)d(X c - (3{9) o C) s 



o 

t 



+ J J 7 S (6» + u)<$>(s,x,9 +u)(ji- u e )(ds,dx). (1.4.14) 
o 

Assume that for each u M 6 {u) = (M e (t,u)) t > G Mf oc (P e ). Then 
(M e (u)) t = [ ( ls (9 + u)$ s (9 + u)) 2 C e s dA e s 



o 





t 



I ^{s,x,9 + u)Bl s {dx)^dA e f 



+ J 7?(0 + uXt(i*){ | $ 2 ( S) x,^ + M )g^(rfx) 



where a s (0) = AA°B^ S (R), < s (dx)/ K(e)>0} = §^g/ K(e)>0} . 
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Now we give a more detailed description of <&(#), 1(9), H e (u) and (M 6 (u)). 
Denote 



Then 



and 



r(^) = F(^)/ {a= o } + ^/W/ {a> o } 



V(9) - FiO)] {ll 0] - (W m + aW)j (e) \ /; ()} 



Therefore 



$(0) 



F(0) 



a(0) 



F(9) {a=0} \f (9) + a(0)(l - a(9)) < { " 



1.4.15) 



with I{ a (d)>o} f j^jQ 6 (dx) = 0. 

Denote $(9) = t(9), Jjg := g§ := ^g^y := *>(6>). 

Indices i = c,ir,5,b carry the following loads: "c" corresponds to the con- 
tinuous part, "7r" to the Poisson type part, "<5" to the predictable moments 
of jumps (including a main special case - the discrete time case), "6" to the 
binomial type part of the likelihood score £(9) = (i c (9),i n (9),i 6 (9),£ b (9)). 
In these notations we have for the Fisher information process: 
t t 
%(&)= f(t s (9)?dC s + [ l(Pl(x-9)) 2 Bl s (dx)dA^ 



+ J BlAR)\f(^e)fqls(dx) 



dA 9 / 



t 

+ J(£ b s (9)) 2 (l-a s (9))dA[ 



e,d 



(1.4.16) 



For the random field H e (u) we have: 



lt (9 + u) ^1(9 + u)(p t (9) - (3 t (9 + u))C 6 t 

+ / t t ( X] e + u)(i- Ft p^ e) u) ) WW 



:0} 



(x; 9 + u)ql t (dx) 



+ £ b t (9 + u 



a t (9) - a t (9 + u) 
a t (9) 



Bl t (R)I {AA e >Q} . (1.4.17) 
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Finally, we have for {M e (u)): 
(M e (u)) t = ( 7 (0 + u)t(9 + u)f C e o A\ 





t 

+ J ^(6 + t*X.(J2) j f (£ 5 s (x; 6 + u)+ t s {9 + u)) 2 ql s {dx) 
o 

- a s {9) ( [ (£ s s (x; 6 + u) + £ b s (9 + u))q e (dx)) ]dA 9 /. (1.4.18 



Thus, we reduced SDE ( 11.4. 121) to the Robbins-Monro type SDE with Kf = 
A 9 t , and H e {u) and M e {u) defined by (jl.4.17p and fll.4.141) . respectively. 
As it follows from fjl.4. 17j) 

H?(0) = for all t > 0, P e -a.s. 

As for condition (A) to be satisfied it ie enough to require that for all t > 0, 
u^O Pg-a.s. 

(3 t {e + u){(3 t {e)-f3 t {e + u))<^ 

f(t,x;6 + u) g \ 

/W^) 9lW jW») M<fl - 

a t (0 + w)(at(0) - a t (0 + w))u < 0, 

and the simplest sufficient conditions for the latter ones is the monotonicity 
(P-a.s.) of functions (3(9), F(6), f{6) and a(6) w.r.t 0. 

Remark 1.4.2. In the case when the model is regular in the Jacod sense only 
we save the same form of all above-given objects (namely of $(0)) using the 
formal definitions: 

-pj^y ^M0)=o} := W(6)I {a{e)=oh 
a(0) := W e , 

ft 0) • W(0\T W&( - 9) T 

j— = W(V)l {a (9)>0} - aiCff) ^ g W >0 >- 

1.4.2. Discrete time. 

a) Recursive MLE in parameter statistical models. Let Xo, Xi, . . . , X n , ... be 
observations taking values in some measurable space (X,B(X)) such that 
the regular conditional densities of distributions (w.r.t. some measure /i) 
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fi(xi,8\xi-i, . . . ,x ), i < n, n > 1 exist, fo(x o ,0) = fo(x ), e R 1 is the pa- 
rameter to be estimated. Denote Pq corresponding distribution on (fl, JF) := 
(^Y 00 , B(X°°)). Identify the process X = (Xj)j> with coordinate process and 
denote JF = cr(X ), T n = a {X h i < n). If ^ = ^{X h J>Q_i, . . . , X ) is 
a r.v., then under Eg(ip\J-' i ^i) we mean the following version of conditional 
expectation 

E e {4) | Fi-i) := J ip(z, Xi-i, X )fi{z, 9 | Xi-i, X )fj,(dz), 

if the last integral exists. 

Assume that the usual regularity conditions are satisfied and denote 

d 

n n fi\Xii 9 I . . . , Xq) . fi(%iy 9 I 3?j_i, . . . , 3?o)> 

69 

the maximum likelihood scores 

h{9) '■= y (Xi, 9 | X;_i, . . . , X ) 

Ji 

and the empirical Fisher information 

n 

I n {9):=Y,Ee{l 2 i {9)\Fi-i)- 

i=l 

Denote also 

b n (9,u) := E e (l n (6 + u) | F n _ x ) 
and indicate that for each 9 e R , n > 1 

b n (0,0) = (Pg-a.s.). (1.4.19) 
Consider the following recursive procedure 

n = n -i + I„ 1 (0 n -i)l n (0 n -i), 9 E JF . 
Fix 9, denote z n = 9 n — and rewrite the last equation in the form 
z n = z n _i + I~ l (8 + z n ^i)b n (9, Zn-i) + I~ l (9 + z„-i)Am„, 
zo = 9 - 9, 

where Am n = Am(n,4_i) with Am(n,u) = l n {9 + u) — Eq(I u {0 + u)\J- n -i). 

Note that the algorithm (11.4.201) is embedded in stochastic approximation 
scheme fll.2.11) with 

H n {u) =I~\9 + u)b n (9,u) G T n-i, AK n = 1, 
AM(n,u) = I~\0 + u)Am(n,u). 

This example clearly shows the necessity of consideration of random fields 
H n {u) and M{n,u). 

In Sharia [39j the convergence z n — > P-a.s. as n — > oo was proved under 
conditions equivalent to (A), (B) and (I) connected with standard representa- 
tion (EL2D(l). 



1.4.20) 
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Remark 1.4.3. Let 9 G B C R l where 9 is open proper subset of R 1 . It 
may be possible that the objects l n {9) and I n {9) are defined only on the set 
G, but for each fixed 9 G O the objects H n (u) and M(n,u) are well-defined 
functions of variable u on whole R 1 . Then under conditions of Theorem 11.2.11 
9 n — > 9 Pg-a.s. as n — > oo starting from arbitrary 9q. The example given below 
illustrates this situation. The same example illustrates also efficiency of the 
representation (jl.2.3p (2). 

b) Galton-Watson Branching Process with Immigration. Let the observable 
process be 

Xi— i 

X i =J2 Y i,i + 1 > i = l,2,...,n; X = 1, 

3=1 

Yij are i.i.d. random variables having the Poisson distribution with parameter 
9, 9 > 0, to be estimated. If Ti = c(Xj, j <i), then 

P e (X t = m | J=U) = 1 e'^-S i = 1, 2, . . . ; m > 1. 

(m — 1)! 



fi(g) = X * 1 a ^ , I n {9) = 9^j^X^. 



From this we have 

^ _ X t - 1 
The recursive procedure has the form 

On = fln-1 + ^ " 1 " 6 -- lXn - 1 , (1-4.21) 

and if, as usual z n = 9 n — 9, then 

Z"n—\Xxi—\ £?1 /-. , r>r>\ 

= Zn— 1 s~^n TP r v- ' \VA.ZZ) 

where e n = X n — 1 — #X n is a Pg-square integrable martingale- difference. 
In fact, Ee{e n \ T n -\) = 0, Eg(e^ \ T n -\) = 9X n -\. In this case H n {u) = 

n n 

— uJ n _i/ ^2 Xi-i, AM(n,u) = Am n = e n / ^2 X^i, AK = 1 and so are 

i=i i=i 
well-defined on whole R 1 . 

Indicate now that the solution of Eq. (11.4.211) coincides with MLE 

n TTUXi - 1) 



X i-1 



and it is easy to see that (9 n ) n >i is strongly consistent for all 9 > 0. 
Indeed, 
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and desirable follows from strong law of large numbers for martingales and 
well-known fact (see, e.g., [TO] ) that for all 9 > 

oo 

^ = oo (Pe-a.s.). (1.4.23) 
Derive this result as the corollary of Theorem 11.2.11 

Note at first that for each 9 > the conditions (A) and (B') are satisfied. 
Indeed, 

(A) H n {u)u = "f^T 1 < 

for all u ^ (Xi > 0, i > 0); 

OO y- 

(B') ^ = 6^2 n y , 2 <oo, 

thanks to fll.4.231) . 

Now to illustrate the efficiency of group of conditions (II) let us consider 
two cases: 

1) < 9 < 1 and 2) 9 is arbitrary, i.e. 9 > 0. 

, n 

In case 1) conditions (I) are satisfied. In fact, \H n {u) \ = (X„_i/ Aj_i 

^ i=i 

oo / n \ 2 

and Yl -^n-i/ ( S -^i-i ) < °°) Pe-CL-s. But if # > 1 the last series diverges, 

71=1 M=l ' 

so the condition (I) (i) is not satisfied. 

On the other hand, the proving of desirable convergence by checking the 
conditions (II) is almost trivial. Really, use Remark 11.3.21 and take G n = 

n oo 

G n = X n _i/5^JQ_i. Then G n = oo Pe-a.s., for all 9 > 0. Besides 

i=l n=l 

S n = -2 + G n <0, \S n \ >1. 

1.4.3. RM Algorithm with Deterministic Regression Function. Consider the 
particular case of algorithm (11.2.11) when H t (u,u) = j t (u!)R(u), where the 
process 7 = (7t)t>o 6 7t > for all t > 0, dM{t, u) = r ytdm t , m G M.\ oc -, i-e. 



u\ 



dz t = j t R(zt-)dK t + j t dm t , z e T { 



o- 



a) Let the following conditions be satisfied: 
(A) R(0) = 0, R{u)u < for all u + 0, 
(B') 7 2 o (m)^ < 00, 

(1) \R(u)\ < C(l + \u\), C > is constant, 

(2) for each e > 0, inf \R(u)\ > 0, 

(3) 7 o < OO, Vt > 0, 7 O = OO, 

(4) -f 2 AK oK^<oo. 

Then z t — > P-a.s., as t — > 00. 

Indeed, it is easy to see that (A), (B'), (1)— (4)=>(A), (B) and (I) of Theorem 
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In Melnikov [28] this result has been proved on the basis of the theorem 
on the semimartingale convergence sets noted in Remark 11.1.11 In the case 
when K d ^ this automatically leads to the "moment" restrictions and the 
additional assumption < const. 

b) Let, as in case a), conditions (A) and (B') be satisfied. Besides assume 
that for each u G R 1 and t G [0, oo): 

(1') V t -(u)+V t + (u)<0, 
(2') for all e > 

J e := inf {-{V-{u) +V + (u))} 0^ = 00. 

— — £ 

Then z t — > P-a.s., as t — > 00. 

Indeed, it is not hard to verify that (1'), (2') =^(II). 

The following question arises: is it possible (1') and (2') to be satisfied? 
Suppose in addition that 

Ci\u\ < \R(u)\ < C 2 \u\, C U C 2 are constants, (1.4.24) 

(3') 2 - C 2lt AK t > 0, 

(4') 7(2 - C 2l AK) o = 00. 

Then (3') (1') and (4') (2'). 
Indeed, 

Vf(u) + V+(u) < C llt \u\ 2 [-2 + C 2lt AK t ] < 0, 

h > Ci^ 2 {7(2 - C 27 AK) o i^oo} = 00. 

Remark 1.4.4. (4') 470 = 00. 

In |3U] the convergence z t — > P £ — > 00 was proved under the 

following conditions: 

(A) i?(0) = 0, < for all u ^ 0; 

(M) there exists a non-negative predictable process r = (r t )t>o integrable 
w.r.t process K = (K t )t>o on any finite interval [0, t] with properties: 

(a) r o = 00, 

(b) A 1 ^ = 7 2 e" 1 (-r o K) o (m)^ < 00, 

(c) all jumps of process A 1 are bounded, 

(d) r t u 2 + ^AK t R 2 (u) < -2 lt R(u)u, 
for all u E R 1 and t G [0, 00). 

Show that (M)^(B'), (1') and (2'). 

It is evident that (b)^(B'). Further, (d)^(l'), Finally, (2') follows from (a) 
and (d) thanks to the relation 

I £ := inf -iy~(u) + V + (u))oK 00 >e 2 roK 00 = (x>. 
£<]«!<§ 

The implication is proved. 

In particular case when (jl.4.24p holds and for all t > jfAKt < q, q > is 
a constant and C\ and C 2 in ( 11.4.24j) are chosen such that 2C\ — qC 2 > 0, if 
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we take r t = bj t , b > 0, with b < 2C\ — qC 2 , then (a) and (d) are satisfied if 
7 o = oo. 

But these conditions imply (3') and (4'). In fact, on the one hand, < 2C% — 
qC\ < Ci(2 - qC 2 ) and so (3') follows, since 2 - C 2 j t AK t >2-qC 2 >0. On 
the other hand, (4') follows from ^(2-C 2 r yAK)oK oa > (2 - qC 2 )j o = oo. 

From the above we may conclude that if the conditions (A), (B'), (11. 4. 241) . 
jtAK t < q, q > 0, 2 — qC 2 > and 7 o = 00 are satisfied, then the 
desirable convergence Zf — > P-a.s. takes place and so, the choosing of process 
r = (r t ) t > with properties (M) is unnecessary (cf. |30j, Remark 11.2.31 and 
Subsection II. 3p . 

c) Linear Model (see, e.g., [28]). Consider the linear RM procedure 

dz t = b'jtZ^dKt + j t dm t , z G T, 

where b G B C (—00, 0), m G Mf oc . 
Assume that 

7 2 Woo < 00, (1.4.25) 

70^00 = 00, (1.4.26) 
7 2 AiT o K d < 00. 

Then for each b G B the conditions (A), (B') and (I) are satisfied. Hence 

zt -> P-a.s., as t -> 00. (1.4.27) 

Now let fll.4.251) and fll.4.26jl be satisfied, but P( 7 2 AK o^ = oo)>0. 

At the same time assume that B = [61,62], —00 < b\ < b 2 < and for all 
t>0j t AK t < 

Then for each be B fll.4.27j) holds. 

Indeed, 

[Vf(u)I {AKtm + V t + (u)} + = \b\ lt u 2 [-2 + |6| 7i A^/ {A/ ,^o } ] + 

< I{AK tm \b\ltU 2 [-2 + \b\ lt AK t } + = 

and therefore (II) (i) is satisfied. 
On the other hand, 

inf n 2 {2 7 |6|/ {A ^ 0} + 6 7 [2 - \b\7AK\ I { ak^}} ° ^00 

£<l«l<7 

> £ 2 |6| 7 [2 - |6| 7 AK] o > e 2 |6| 7 o = 00. 

So (II) (ii) is satisfied also. 



%t — z 
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2. Rate of Convergence and Asymptotic Expansion 

2.1. Notation and preliminaries. We consider the RM type stochastic dif- 
ferential equation (SDE) 

t t 
+ J H s (z s _)dK s + J M(ds,z s _). (2.1.1) 



As usual, we assume that there exists a unique strong solution z = {z t )t>o 

of Eq. (F2XT|) on the whole time interval [0, oof and M = (M t )t>o e Mf oc {P), 

, t 

where M = J M(ds,z a -) (see [8], [9], p3]). 

o 

Let us denote 



assuming that this limit exists and is finite for each t > and define the 
random field 

H t {u) 



^ if u ^ 0, 



p t if u = 0. 
It follows from (A) that for all t > and u e R 1 , 

Pt>0 and /3t(u) > (P-a.s.). 
Further, rewrite Eq. (12.1.11) as 



t 



z t = z - J (3 s z s _I {l3sAKs ^ 1} dK s + J M{ds, 0) - ^ z s _I {f3sAKs=1} 

o o s - 1 

t t 

+ J {I3 8 - (3 s {z s -.))z s „dK s + J (M(ds, z s _) - M{ds, 0)) 



(we suppose that M(-, 0) ^ 0). 
Denote 

Pt — l3tI{f3 t AK t ^l}> Rt — ~ ^2 Z s~hl3sAK s =l}, 

s<t 

t t 

Rf ] = J {Ps- PsM)z a -dK a , = J {M{ds, z s _) - M{ds, 0)). 





In this notation, 

t t 



where 



(!) , r(2) , d(3) 



Rt = Rf + Rf + R 
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Solving this equation w.r.t z yields 

t t 
z t = r- 1 (zq + j T s M(ds, 0) + J T s dRA , (2.1.2) 







where 



r t = e; 1 (-poK). 

t 

Here, a o K t = j a s dK s and e t (A) is the Dolean exponent. 



o 



The process T = (T t ) t > is predictable (but not positive in general) and 
therefore, the process L = (L t ) t > defined by 

t 

T s M(ds,0) 



o 



belongs to the class Mf oc (P). It follows from Eq. ( 12. 1.2ft that 

* tZt ~ 77 ,1/2 + 
\ L t)t 



where 



Xt = r t (L); 1/2 , 

t 

Zq 1 



Rt — 777 H TF> I ^sdR 

(L)l /2 (L)l /2 



o 

F,P 



and (L) is the shifted square characteristic of L, i.e. (L) 4 := 1 + (L) t 

This section is organized as follows. In subsection 12.21 assuming z t — > as 
t — > oo (P-a.s.), we give various sufficient conditions to ensure the convergence 

7 t % 2 ^0 as t -> oo (P-a.s.) (2.1.3) 

for all < 5 < 5o, where 7 = (7t)t>o is a predictable increasing process and 5o, 
< So < 1, is some constant. There we also give series of examples illustrating 
these results. 

In subsection 12.31 assuming that Eq. (12.1.31) holds with 7 asymptotically 
equivalent to x 2 (see the definition in subsection 12.21 we study sufficient con- 
ditions to ensure the convergence 

p 

R t — > as t — > 00, 

which implies the local asymptotic linearity of the solution. 

We say that the process £ = (£*)t>o has some property eventually if for every 
uj in a set Qq of P probability 1, the trajectory {£t{u))t>o of the process has 
this property on the set [to(uj), 00) for some t (u>) < 00. 

Everywhere in this section we assume that z% — > as t — > 00 (P-a.s.). 
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2.2. Rate of convergence. Throughout subsection 12.21 we assume that 7 = 
(lt)t>o is a predictable increasing process such that (P-a.s.) 

7o = 1, 7oo = 00. 

Suppose also that for each « 6 I 1 the processes (M(u)) and 7 are locally 
absolutely continuous w.r.t. the process K and denote 

d(M(u),M(v)) t dj t 
ht{u,v) = — — and g t 



dK t ^ dK t 

assuming for simplicity that g t > and hence, I{AK t ^o} — ^{A 7t ^o} (P-a.s.) for 
all t > 0. 

In this subsection, we study the problem of the convergence 
jfct — > as t — > 00 (P-a.s.) 

for all 5, < S < 6 /2, < 5 < 1. 

It should be stressed that the consideration of the two control parameters 5 
and #o substantially simplifies application of the results and also clarifies their 
relation with the classical ones (see Examples 1 and 6). 

We shall consider two approaches to this problem. The first approach is 
based on the results on the convergence sets of non-negative semimartingales 
and on the so-called "non-standard representations" . 

The second approach presented exploits the stochastic version of the Kro- 
necker Lemma. This approach is employed in [39] for the discrete time case 
under the assumption (12.2.23)) . The comparison of the results obtained in this 
section with those obtained before is also presented. 

Note also that the two approaches give different sets of conditions in general. 
This fact is illustrated by the various examples. 

Let us formulate some auxiliary results based on the convergence sets. 

Suppose that r = (r t ) t > is a non-negative predictable process such that 

r t AK t < 0, r o K t < 00 (P-a.s.) 

for each t > and 

r o = 00 (P-a.s.). 
Denote by e t = £t(— r o K) the Dolean exponential, i.e. 

e t = e-ti r ° dK °\[(l-r a &K s ). 

s<t 

Then, as it is well known (see [25], [28]), the process e^ 1 = {e t (— r o K)}^ 1 
is the solution of the linear SDE 

£t l = ^ l r t dK t} £q 1 = 1 

and e^ 1 — ► 00 as t — > 00 (P-a.s.). 
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Proposition 2.2.1. Suppose that 

oo 

J e- l E t „[r t - 2(3 t (z t .) + $(z t _)AK t ] + dK t < oo (P-a.s.) (2.2.1) 
o 

and 

oo 

J ' e;%(zt-,zt-)dK t <oo (P-a.s.), (2.2.2) 
o 

where [x] + denotes the positive part of x. 

Then e~ x z 2 — > (P-a.s.) (the notation X — > means that X = (X t ) t > has a 
finite limit as t — > oo). 

Proof. Using the Ito formula, 

d(et l z 2 t ) = zl_ds- x + E~ l dz 2 t 

= e; l z 2 t _(r t - 2ft(z t _) + $(z t „)AK t )dK t 

+ s~ x h t {z t -, z t _)dK t + d(Mart) 
= e^ x z\_dB t + dA\ - dA 2 t + d(Mart), 

where 

dB t = V [r t - 2f3 t (z t _) + f3 2 (z t _)AK t ] + dK u 
dA\ = e^htizt-, z t -)dK t , 

dA\ = £f ~V [r t - 2f3 t (z t _) + $(z t „)AK t y dK t . 

Now, applying Corollary ll.l.4l to the non-negative semimartingale (e^ z^)t>o, 
we obtain 

< 00} n {Al < 00} C {e-'z 2 ^} n {Al < 00} 
and the result follows from Eqs. fl2XT]) and f[2X2j) . □ 

The following lemma is an immediate consequence of the Ito formula apply- 
ing to the process (jf)t>o, < 5 < 1. 

Lemma 2.2.1. Suppose that < 5 < 1. T/ien 

7 J = e t - 1 (-r , o/0, 

where 

4 = rigtht 

and 

r t - W{A 7t =o } + Aa 7 ^o}- 

The following theorem is the main result based on the first approach. 
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Theorem 2.2.1. Suppose that for each 5, < 5 < 5 , < 5 < 1, 

[rf - 2[3 t (z t _) + ff(z t _)AK t } + dK t < oo (P-a.s.) (2.2.3) 

It J 



and 



J "f 5 t h t (z t -,z t J)dK t < oo (P-a.s.). 



(2.2.4) 



Then •yfz 2 — > as t — > oo (P-a.s.) for each 8 , < 8 < 8 , < 8 < 1 . 

Proof. It follows from Proposition ^. 2.11 Lemma r2.2.1l and the conditions (I2.2.3P 
and (12^41) that 

P{ 7 V ^} = 1 

for all 8, < 8 < 6q, < Sq < 1. Now the result follows since 

{ 7 V -> for all 5, < 8 < 8 } { 7 V -> for all 5, < 5 < 5 }. □ 

Remark 2.2.1. Note that if Eq. (12T2T5]) holds for 8 = 8 , than it holds for all 
8 <8 . 

Some simple conditions ensuring Eq. (12.2.31) are given in the following corol- 
laries. 



Corollary 2.2.1. Suppose that the process 

7 

— is eventually bounded. 

7- 

Then for each 8, < 8 < 8 , < 8 < 1, 



(5/ { a 7 =o } + Wo} 9 ~ - 2/3(2-) + f(zJ)AK 



(2.2.5) 



C 



<f + (1 - <f) — 1 - - 2/3(^-) + f3 2 (z-)AK 
7/7 



O if^ < OO 

O ifoo < OO 



C <j ( ^ ) [r 5 - 2/3(z_) + /? 2 (z_)Alf]+ o ^ < oo \. 



7 

Proof. The proof immediately follows from the following simple inequalities 

1 - (1 - x) s < 5x + (1 - 5)x 2 < x 
if < x < 1 and < 5 < 1, which taking x = Ajt/jt gives 



ft < [ 8 + (1 - 5) t±!l ) < (W {A7t=0} + I { a 7 ^o})- 



A7< 



It 



It remains only to apply the condition (12. 2. 5ft . 



□ 
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In the next corollary we will need the following group of conditions: 
For 5, < 5 < S /2, 



5 9 --(3{z) 
. 1 



K c 00 <oo (P-CL.S.), 



(2.2.6) 



E 
E 

t>o 



(l-PtMAKt-ll 



{(3 t {z t .)AK t -1-1 



Alt 

It 

Ajt 
It 



-i + 



AK t <i} < oo (P-a.s.), (2.2.7) 



J{ft(*_)AJCt>i} < oo (P-a.s.). (2.2. 



(2.2.9) 



Corollary 2.2.2. Suppose that the process 

(p t (zt-)AKt)i>o is eventually bounded. 
Then if Eq. fTO~5j) holds, 

(1) { fTO^j) . PX7| ) ; (jO^jl /or a// 5, < 5 < 5 / 2 } /or a// 5, 
0<5< 5 }; 

(2) i/, in addition, the process £ = (£t)t>o> £ t = sup(A7 s /7 s ) is even- 



s>t 



tually < 1, then the reverse implication "<=" holds in (1); 
(3) {$E£M, PX7| ) ; M /or 5 = 5 /2} { (jO^I , flOTTE , ff^I^D /or 
a// 5, < 5 < Sq/2} ( here Sq is some fixed constant with < 5q < 1). 

Proof. By the simple calculations, for all 5, < 5 < 5q, < 5q < 1, 



Ji- 
lt 



-s 



i - (i - A lt / lt y 



A'jt/lt 



-2p t (z t -.) + ft{zt-)&K t 



6^-2/3 t (z t . 
. It 



9t 
It 

+ 



dKf 



E 

t>o 



It- 
It 



(l-(3 t (z t _)AK t -(l-A lt / lt f 2 ) 



[l-Pt(zt-)AK t + (l 



i{/3t(z t -)AK t <l} 



E 

t>o 



It- 
It 



-5 



(p t (z t .)AK t -l + (l-A lt / lt f 2 ) 



x [p t (z t -)AK t - 1 - (1 - A lt / lt ) & / 2 ] I {Pt(zt _ )AKt >i } . (2.2.10) 

Now for the validity if implications (1) and (2) it is enough to show that 
under conditions (I2.2.5P and (12.2.91) . the processes 

(1 - P(zJ)AK + (1 - A7/7) 5 / 2 ) I{/3(z-)AK<l} 

and 

{P(z„)AK-l + (l-A 1 / 1 y' 2 ) 

I{/3(z-)AK>l} 
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are eventually bounded and, moreover, if £ < 1 eventually, these processes are 
bounded from below by a strictly positive random constant. Indeed, for each 
< 5 < 1 and t > 0, if p t (z t _)AK t < 1, 

A 7s 



sup 

s>t 7s 



< 1 - PtMAK t + (1 - A lt / lt f 2 < 2 



(2.2.11) 



and, i£Pt(zt-)AK t > 1 
A 7 . 



sup ■ 

s>t 7s 



< (3 t (z t -)AK t - 1 + (1 - A lt / lt ) 5 l 2 < Pt(zt-)AK t . (2.2.12 



The implication (3) simply follows from the inequality (1 — x) s < (1 — x) 1 ^ 2 
if < x < 1 and < 5 < 1/2. □ 

The following result is an immediate consequence of Corollary 12.2.21 

Corollary 2.2.3. Suppose that 

'At/ " 
it 



5^ J {A(^-)Ax t >i} < oo and ^ 

t>0 t>0 

Then Eq. i\2.2. 1\ is equivalent to 



< oo (P-a.s.). (2.2.13) 



ItPtjzt- 
It 



— - < oo (P-a.s.) 

It 



(2.2.14) 



and 



{(HJig, \2.2.U\ for all 5, 0<5< 5 /2} { (f^Oft for all 5, < 5 < 5 }. 

Proof. The conditions (12.2.81) and fl 2 . 2 . 9 [) are automatically satisfied and also 
£ < 1 eventually (£ = (£t)t>o is the process with £ t = sup(A 7s / 7s )). So it 

s>t 

follows from Corollary [2X2 (2) that 

{ (12X61) . (12X71) for all 5, < 5 < 5 /2} => { (12X31) for all 5, < 5 < 5 }. 

It remains to prove that Eq. (I2.2.7I) is equivalent to Eq. (I2.2.14I) . This 
immediately follows from the inequalities 

[a + b) + < [a] + + [b] + , 5x < 1 - (1 - x) 5 < 5x + (1 - 5)x 2 , 
< x < 1, < 5 < 1, 
applying to the x = (A 7s / 7s ) and to the expression 

[l-P t (z t _)AK t + (l-A lt / lt ) 5 ] + , 

and from the condition ^(A 7t / 7t ) 2 < oo (P-a.s.). □ 

t>o 

Remark 2.2.2. The condition (12.2. 14[) can be written as 



t>o 



5 



It 



Pt{z t -)AK t 



< oo (P-a.s.). 
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Below using the stochastic version of Kronecker Lemma, we give an alter- 
native group of conditions to ensure the convergence 

^fz t — ► as t — > oo (P-a.s.) 

for all < 5 < 5 /2, < 5 < 1. 

Rewrite Eq. (12.1.11) in the following form 

t 

z t = z + J z s _dB s + G t , 
o 

where 

dB t = -p t (zt-)dK t , ]3 t (u) = Pt(u)I {Mu )AKtm 

and 

t 

G t = -J2 ^s-I{Mzt-)AK t =i} + I M{ds, z,_) . (2.2. 15) 

Since AB t = —j3 t (z t -)AK t ^ —1 we can represent z as 

t 

z t = e t (B)(z + [ e;\B)dG s 



and multiplying this equation by yields 

t 

1 5 t zt = sign E t (B)T { t S) (z + J si gn£s (5){r( 5 )}-SfdG s Y (2.2.16) 

o 

where lf } =1 s t \e t (B)\. 

Definition 2.2.1. We say that predictable processes £ = (£t)t>o and rj = 
(Vt)t>o are equivalent as t — > oo and write £ ~ r] if there exists a process 
C = (Ct)t>o such that 

6 = 

and 

o < c 1 < ICI < C 2 < oo 

eventually, for some random constants C 1 and ( 2 . 

The proof of the following result is based on the stochastic version of the 
Kronecker Lemma. 

Proposition 2.2.2. Suppose that for all S , < 5 < So/2, < 5q < 1, 

(1) there exists a positive and decreasing predictable process = (T[ ) t >o 
such that 

If) = i (p-a.s.), p{ limrf = o} = i, ~ 

and 
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(2) 

^/{/3 t(2t _)Ax t =i}<oo (P-a.s.), (2.2.17) 



oo 



T?ht(zt-,Zt-)dK t <oo (P-a.s.). (2.2.18) 

o 



Then 



ryfzt — ► as t —y oo (P-a.s.) 
for all < S < 5 /2, < 5 < 1. 

Proof. Recall the stochastic version of Kronecker Lemma (see, e.g., [25], Ch. 2, 
Section 6): 

Kronecker Lemma. Suppose that X = (X t ) t > is s semimartingale and 
L = (L t )t>o is s predictable increasing process. Then 

{L 00 = oo}n{F {f^oj (P-a.s.), 

where Y = (1 + L)~ l ■ X . 

_ t 

Put (1 + Lt)- 1 = rf } and X t = /(r^)" 1 signe s (B)<y s s dG s . Then it follows 

o 

from the condition (1) that L is an increasing process with = oo (P-a.s.) 
and 



A = {rg = }n || ri 5 )(r( 5 ))- 1 signe s (i?) 7 frfa 

o 

" I i^y'^siB^dGs - oj C - 0}, 

o 

where the latter inequality follows from the relation ~ and Eq. 

At the same time, from Eq. ( 12.2. 15ft and from the well-known fact that if 
M G Ml c , then {(M)^ < oo} C {M ^} (see, e.g., [25]), we have 

oo 

{rg = 0} n | X) j w.(*-)ajc«=i} < °°} n { / ^ 



^ t _, z t -)dK t < oo C A. 



The result now follows from Eqs. (12.2. 17|) and (12.2.181) . □ 

Now we establish some simple results which are useful for verifying the 
condition (1) of Proposition 12.2.21 
By the definition of e t (B), 

e t (B) = e B ^l[(l + AB s ) 

8<t 
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and since 



we obtain 



7? = exp(* J ^-E^t 1 



A 7s 

7* 



If =a,p(B? + */*£ + 5> 



exp 



7. 



|1 + Aff s 



D s dCg i . 



(2.2.19) 



where = I/71 and 



(5) 



/3 S (> S _)7 S 



-5 / 



'{A 7s =0} 



Is 



log 



II + A5 e 



A 7s _ ^rs) 

Using the formula of integration by parts 

d(D t C t ) = D t dC t + Ct_dD t 

and the relation 



-f{A 7a ^0} C?7s 



d lr) = _L*» 

7t/ 7t- 7t 



we get from Eq. 02.2.191) that 



1 1 = exp 



(6) 



It 



c 



(5) J_ dru 

Is- Is 



(2.2.20) 



Therefore, 



where 



(5) 
i 5 



"(5) 



exp 



t 

(-/ 






.7s- . 



— , Ct = exp 



(5) 



7t 



+ 



a 



(S) 



Is 



(2.2.21) 
7 S )' 



The following proposition is an immediate consequence of Eq. (12.2.211) . 

Proposition 2.2.3. Suppose that for each 8, < 5 < So/2, < S < 1, the 
following conditions hold: 



3(> 
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(a) There exist random constants Q_{8) and C(5) such that 

C® - 
-oo < C(5) < < C(5) < oo 

7 

(5) 



(b) 



eventually, where = (C\ /it)t>o- 

< 00 (P-a.s.). 

= 00 (P-a.s.). 







.it- . 


It 




+ d-f t 


.it- _ 


It 



Then V® ~ for each 5, < 8 < 6 /2. 
Corollary 2.2.4. Suppose that 

(j(8 /2) n(0) _ 

< < < (7(0) < 00 

7 7 

eventually, where (7(0) zs some random constant and the processes C^ ^ 2 ^ and 
C^°> are defined in Eq. (\2.2.20t> for 5 = 8 /2 and 6 = 0, respectively. 
Then ~ W for each 5, < 5 < 5 /2, < 8 < 1. 



(S /2) ^ n {6) ^ C (S) 



This result follows since, as it is easy to check, 

C (So/2) 

for each 5, < 5 < 5 /2, which gives 

!-*<^<Z7(0) 

2 7 



> 



j -S) it 



and 



7 



> 



5n 



5 and 



eg) 

7 







eventually. 

We shall now formulate the main result of this approach which is an imme- 
diate consequence of Propositions 12.2.21 and 12.2.31 

Theorem 2.2.2. Suppose that the conditions < \2.2.17[ , <\2.2.18ff and the con- 
ditions of Proposition \2.2.3\ hold for all 8, < 8 < 8q/2, < 8q < 1. Then 
P-a.s., 

7 t z t — > as t — ► 00 
/or a// 5, < 5 < 5 /2, < <5 < 1. 



Consider in more detail two cases: (1) all the processes under the consid- 
eration are continuous; (2) the discrete time case. In addition assume that 
M(t, u) = M(t) for all w G -R 1 , t > 0. 
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In the case of continuous processes conditions ( 12. 2. 7ft and ( 12. 2. 8ft are satisfied 
trivially, the condition (12.2.61) takes the form 



5- 



ItPtjzt- 
9t 



< oo (P-a.s. 

It 



(2.2.22) 



and also 

{ (I2.2.22P for 5 = 5 /2} { (12.2.221) for all 5, < 5 < 5 /2}. 
Further, since 



a 



It It 



d'js - 5 > -5, 



the conditions (a)-(c) of Proposition 12.2.31 can be simplified to: 
(a') The process 



1 

It 

is eventually bounded. 



d'ji 



t>o 



(b') 
(c') 



1 f (3 s (z s )^ s 



It 





oo t 







1 

It 



9s 







9s 



d'js - 5 



d'js - 5 



'djt 
It 

djt 
It 



< oo (P-a.s.). 
= oo (P-a.s.). 



Also, if (a') holds and 
t 



(be') 



C(*>/2) 

7 



1 

7t 



"7s 
9s 2 



> 0, eventually, 



t>o 



then (b') and (c') hold for each 5, < 5 < 5 /2. 
In the discrete time case we assume additionally that 

2 f ~) < 00 and S^*^*- 1 ^ 2 < 00 ( p -°- s -)- (2.2.23) 

t>o V ^* / i>o 

Then the conditions of Corollary 12.2.31 are trivially satisfied. Hence, the 
conditions (I2.2.3P and (12.2.141) are equivalent and can be written as 



t>o 



ItPtjzt -i) 
9t 



i + 



A 7 



It 



- < oo (P-a.s. 



(2.2.24) 



and also, 



{ (12.2.241) for 5 = 5 /2} { (12.2.241) for all 5, < 5 < 5 /2} . 
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Note that the reverse implication "<^=" does not hold in general (see Exam- 
ple ED- 

It is not difficult to verify that (a), (b) and (c) are equivalent to (a), (b) and 
(c) defined as follows. 

(a) The process 



H s<t ' 



t>0 



is bounded eventually. 



7t-i 

i>l s<t 



Also if fa) holds and 



'A7t 
7t 



< oo (P-a.s.). 



oo (P-a.s.). 



(be) ( — 5^^ 8 (z a _i)7 8 -<y J > S /2 eventually. 



then (b) and (c) hold for each S, < 5 < S /2. 

Hence {(a), (be)} =>- {(a), (b), (c) for all 5, < 5 < <5o/2}. However, the 
inverse implication is not true (see Examples [3] and HI) . 

Note that the conditions imposed on the martingale part of Eq. (12.1.ip in 
Theorems I2XD (see Eq. (JM3D) and I2T2T21 (see Eq. 02.2.180 ) are identical. 
We, therefore, assume that these conditions hold in all examples given below. 

Example 1. This example illustrates that Eq. (12.2.221) holds whereas (a') is 
violated. 
Let 

K t = lt = t + l and (3 t (u) = (t + l)-^ 2+a \ 

where < a < 1/2. 

Substituting K t , 7 t , (3 t in the left-hand side of Eq. (12.2.221) we get 

oo oo 

/ ^-(t + ir (1/2 - Q) (t + i)] + ^f T = / [s-(t + i) 1/2 - a } + ^. 



Since {[5 -(t+ l) 1/2 ' a ] + )t>o = eventually, the condition (12. 2. 221) holds. 
The conditions (a') does not hold since 



1 f (3 s (z s )j s 



It 



-^j J(s + l) l/2 ~ a ds oc (t + 1) 1/2 ~ Q 



oo as t oo. 



Note that the conditions (b') and (c') are satisfied. 
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It should be pointed out that although Eq. (12.2.221) holds for all 5, 5 > 0, 
if, e.g., 

rf < M >' = ( t+ iV° ' 

the conditions C I2.2.4I) only holds for <5's satisfying < 5 < 5q = 1/2 + a. 

Example 2. In this example the conditions (a) and (be) hold for 5q = 1 while 
Eq. ( 12.2.240 fails for some 5, < 5 < 1/2 = 5 /2. 

Consider a discrete time model with K t = ^ t = t, (3 t {u) = (3 t and 



Ptlt 



1/2 + a if t is odd, 
1/2 — 6 otherwise, 

where < b < 1/2 < a. Then, since 



1 1 V- a 

- + a > — p s j s 



It 



s<t 



a—b 
2 



if t = 2k, k = 1,2, 



k{c t7 b) + a if t = 2fc + l, k = 1,2, 



> 



2fc+l 



2 ■ 



the conditions (a) and (be) hold for 8 = 1. 

It is easy to verify that if 1/2 — b < 5 < 1/2, then 



£[<*-A7,] + i = £ 



-*{t is even} 



t>l t>l 

implying that Eq. (12.2.241) does not hold for all 5 with 1/2 < 6 < 5 < 1/2. 
Example 3. In this discrete time example 8q = 1 and 

{ (12.2.241) for all 5, < 5 < 1/2} ^ { (12.2.241) for 5 = 1/2}. 
Suppose that K t — j t — t, (3 t {u) = /3 t and 

1 1 



Pat 



[2 io g (t+i; 

Then for < 5 < 1/2 and large t's, 

[5-At*] + = o 

and it follows that 



X> - A7*] + ^ < oo. 
t>i 



But for 5 = 1/2, 
1 



t>i 



-Pat 



* -£>fio g (* + i; 



Note also that by the Toeplitz Lemma, 

T 1 



2 log(s + 1) 



'{iog(m)>i} 



t - as t 



oo. 



oo. 
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Therefore, for all 5, < 5 < 1/2, the conditions (a), (b) and (c) hold whereas 
(be) does not. 

Example 4. This is a discrete time example illustrating that Eq. (I2.2.24p 
holds for 5 = 1/2 (hence for all < 5 < 1/2) and for all 5, < 5 < 1/2, the 
conditions (a), (b) and (c) hold whereas (be) does not. 
Suppose that K t — jt = t, f3 t {u) = (3 t and for t > 0, 

Ptlt = • 

Then for 5 = 1/2 the condition (I2.2.24f) follows since 

+ 



E 

t>2 

It remains to note that 



by the Toeplitz Lemma. 



2 - At* 



t ^t 2 

t>2 



< oo. 



Example 5. Here we drop the "traditional" assumptions 

< oo and ^(A(^-i)) 2 < oo (P-a.s.) 

and give an example when the conditions of Theorems 12.2.11 and 12.2.21 are 
satisfied. 

Suppose that K t = t and process 7 and (3{u) = [3 are defined as follows: 
7i = 1, 



It = Y] q s = ~r— (! - <?*), where q > 1, 



s=l 



and 



n — -3 > 

P It 

where a = q/(q — 1) and [3, [3 > 1, are some constants satisfying (1 — 1/ct) 1 / 2 > 

A 7t 



1//?. In this case, 



It 



a 



and 



as t — > 00 



1 



— < 1 as £ — ► 00. 



Therefore the conditions of Corollary 12 . 2 . 31 hold and it follows that the con- 
ditions ( 12.2.31) and ( 12.2. 141) are equivalent. 

To check Eq. (12.2. 14j) note that for all < 5 < 1 /2, 



E 

i>0 



1 - /3 t (z t _) Ai^ 



1 - 



A 7f 

7* 



f{/3t(z t _)Aift<l} 
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<-J2 

t>0 

But since 



l-f3 t (z t _)AK t -[ 1 



A 7< 



7t 



1 g* 



/3g*-l 



1 g 



t \ 1/2' 



a q t — 1 



4/3t( 2t _)AX t <l} 



'{/3 4 (%_)A^<1}- 



1 g* 



/?g'-l 



- 1 



1 q 



t \ 1/2 



a g* — 1 



we have 



1 g* 



1 



1 g 





t \ 1/2' 



1 - 



a 







1/2 



<o, 



/? g* — 1 \ a g* — 1 

for large t's. Hence Eq. (12.2.141) holds. 

To check the conditions (a), (b) and (c) of Theorem 12.2.21 note that by the 
Toeplitz Lemma, 



It 



a 



— V A 7s log 



|l-A(^-i)| 7s 



where 



1-1//3 , 1-1//3 
a = —a log — r-r-rr > —a log — — > 0, 



(1 -1/a) 5 
which implies (a), (b) and (c). 



(1 - l/a)V2 



2.3. Asymptotic expansion. In subsection 12.11 we have derived the repre- 
sentation 

Xtz t = ^kj2+Ru (2.3.1) 



(L) 



where all objects are defined there. 

Throughout this subsection we assume that 

(L)oo = oo (P-a.s.) 

and there exists a predictable increasing process 7 = ( 7 t)t>o such that 70 = 1, 
7oo = 00 (P-a.s.), the process 7 / 7 _ is eventually bounded and 

7 ~r 2 (L)- 1 . 

In this subsection, assuming that ^ 5 t z t — > P-a.s. for all < 5 < 5q/2 (for 

some < 5q < 1), we establish sufficient conditions for the convergence R t — > 
as if: — > 00. 

Consider the following conditions: 

(d) There exists a non-random increasing process (((L)) t ) t > such that 

(L)t d 



((L))t 



( as t — > 00, 
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where — ► denotes the convergence in distribution and £ > is some 



random variable. 

( e ) J^{/3 t AA' t =l} < oo {P-a.s.). 

t>0 

(f) There exists e, 1/2 - 5 /2 < s < 1/2, such that 

t 

jj^-J \p s - (3 s (z s „)\j £ s _(L) s dK s — as t -> oo (P-a.s.). 



o 

t 

r;(/'s( :,-)- 2//,( :,_.()) 4 //,((). 0)) f /A', - as / - oc. 

o 

Theorem 2.3.1. Suppose that jfz t — > P-a.s. /or all 5, < 5 < 5 /2 (0 < 
<5o < 1); ^ e conditions (d)-(g) are satisfied. Then 

p 

R t — > as t — > oo. 
Proof. Recall from subsection 12.11 that 

^* = , ,1/2 ^0 + P*^ + P| 2) + PP\ 



where 



^ ~ ~ , . 1/2 r «^-^. AJf.=l} , 

t 

p 4 (2) = — -772 / r.^-ftOO)*.-^., 

(£>r / 

t 

^ (3) = / r s (M(ds,z s _) -M(ds,0)). 

1 /2 

Since — > oo, we have zo/(L) t — > as i — > oo. Further, it follows from 
(e) that the process (/{/3 t Ax t =i})t>o — eventually and therefore P^ — > as 
t — > oo. 

Since the process 7/7- is bounded eventually and 7 4 1//2 £ ^ — > as £ — ► 00 
(P-a.s.), we obtain that the process 7 1 / 2_e z_ is bounded eventually for each e, 
1/2 - <5 /2 < e < 1/2. Also, iri(L)- 1 / 2 ~ 7 1 / 2 . It therefore follows that there 
exists an eventually bounded positive process rj = (r) t )t>o such that 

t 

>(2)- - 1 



|Pn<--i7J / |r fl ||&-&(z s _)||z s _|dAT s 
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1/3, " /}.(z,-M{L)s1, 4n75 = TTTTn I 



where 

A = — = [\f3s- p^MWrtdK,. 

(L)t { 
Using the formulae d(D t C t ) = D t dC t + C t -dD t we obtain 



6' ■ 



t 



\Rt\<\^ct-^Jct_d{L):^ 



It is easy to check that 

d{(L)t 1/2 ) 

and 



1 d(L) 



1/2 



<I# 2 (L)l /2 



t 

Now, from the condition (f) and the Toeplitz Lemma, R± — > 0, P-a.s. 
To prove the convergence R^f 1 — > note that by the condition (d), it suffices 
only to consider the case when (L) t is non-random. Denote 

t 

N t = fv s (M(ds,z s -)-M(ds,0)). 



Using the Lenglart-Rebolledo inequality (see, e.g., [25J, Ch. 1, Section 9, 
[22] ) we obtain 

P{(L}; 1/2 N t >a} = P{(L)- 1 iV 4 2 > a 2 } = P{iV 2 - (L) t e > (a 2 - e)(L) t } 

(a 2 - 

for any a > 0, b > and < e < a 2 . The result now follows since (L)^ = oo 
P-a.s. and 

t 



as oo. □ 

Remark 2.3.1. Suppose that P-a.s., 

poK OQ = oo, inf PJ{AK t ^o} > 0, sup p t AK t Ii AKt ^ 0} < 2. 
*>° t>o 

Then, as it is easy to see, |T| is an increasing process with ir^l = oo (P-a.s.). 
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Remark 2.3.2. 

1. The condition (f) can be replaced by the following one: (f ) there exists 
e > (1 — S )/5q such that 
t 

}yj \[3 S - p s (z s _)\\z s _\- £ (L) s dK s ^ as t^oo (P-a.s.). 



(L) 



o 



2. It follows from Eq. (12.3. ip that under the conditions of Theorem 12.3.11 
the asymptotic behaviour of the normalized process (xt z t)t>o coincides 
with the asymptotic behaviour of (L t /(L) t )t>o as t — > oo. 

3. Assume that the first two conditions in Remark 12.3.11 hold and besides, 

sup (3 t AK t I {AKtJ t 0} < 1 (P-a.s.). 

t>o 

In this case, (3 t = PJ{f3 t AK t ^i} — Pu T = /3 o K) is a positive 

increasing process, Y t f oo (P-a.s.) as t — > oo and if we suppose that 
T ~ (L), then taking 7 = (L) we obtain 

7 ~ r 2 ^)" 1 ~ r 

and under the conditions of Theorem 12.3.11 



T l J 2 z t = L \ /9 + R t , i?(-^0 as t-> 00. 
(L)] /2 



Note that for the recursive parametric estimation procedures in the discrete 
time case, T 2 (L)~ l = T (see [39]). 

Example 6. The RM stochastic approximation procedure with slowly varying 

gains (see [31]). 

Consider the SDE 

, aR(z t ) 1T , a , 
dzt — ttt- dKt + r— - dm t . 

(i + K t y (i + K t y 

Here K = (K t ) t > is a continuous and increasing non-random function with 
= 00, 1/2 < r < 1, < a < 1, m = (m t ) t > e -Mf oc (P), d<m) t = <7?d#t, 
of — ► a 2 > as £ — ► 00 and non-random regression function R satisfies the 
following conditions: 

R(0) = 0, uR(u) > if u + 0, 
for each e > inf uR(u) > and 

e<|«|<| 

-R(m) — Pu + v(u) with f (m) = 0(w 2 ) as w — > 0. 
In our notation, 

a/3 aR(u) 

& = /-. , Em; and ^ M 



y i + K t y ' lv ' it(l + tf t ) p 

It follows from Theorem 11.2.11 that P-a.s. 

z t — > as £ — ► 00. 
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with r t = et\-l3oK), 



L t = / r 



a 



dm s , Xt = F 2 t {L) t 1 



and 



t 

i?t = —U; / r s (/3 s - p t (z.-))z 9 -dK. 
(L))' 1 J 



- ---1/2 



On can check that 



as t — > 00. Since 



(^) t 1/2 



at(o,i; 



if the convergence R t — > holds, then 



(2.3.2) 



It remains to prove that R t — > as t — > 00. Let us first prove that if 
1/2 < r < 1, then P-a.s., 

(1 + i^)" 5 ^ -»• for all 6 < 1 - — . (2.3.3) 



It is easy to verify that 



1 + K t r° = e t 



2rS _ _-l 



2r5 



2r 



oK . 



(1 + 10 

Therefore, the conditions (12.2.31) and (12.2.41) of Theorem 12 . 2 . ll can be rewrit- 



ten as 



2r5 2af3 2av(z t ) 



[l + KA (l + K t Y z t (l + K t 



dK t < 00 (P-a.s.) (2.3.4) 



and 



■ 1 + K W °?*t 



1 + Krfr 



dK t < 00 (P-a.s.). (2.3.5) 



The condition (12.3.41) holds since 

2rS 2a[3 2av(z t ) 

[1 + K t )~ (l + K t Y~ z t (l + K t ] 
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eventually. The condition (12.3.51) is satisfied since 2r — 2r5 > 1 if 5 < 1 — l/(2r). 
So, Theorem 12.2.11 yields Eq. (I2.3.3p . The conditions (d) and (e) of Theorem 
12.3.11 are trivially fulfilled. To check (f) note that from the Kronecker Lemma 
it suffices to verify that 



j \Pt-Pt(ztMdK t <oo (P-a.s. 



for some e with 1/2 - S /2 < e < 1/2, 5 = 2 - l/r. For each 5, < 5 < 
5 /2 = 1 - l/(2r), we have 







DC 

< e /(l + K t )- r{a+5 -^dK t 



for some random variables £. It therefore follows that if there exists a triple r, 
5, £ satisfying inequalities 

- < r < 1, < 5 < - , £ > 0, r(l + 5 — e)>l, 

< £ < - , 8 < 1 , 

2r 2 2 ' 2r ' 

then Eq. (12.3.21) holds. It is easy to verify that such a triple exists only for 
r > 4/5. It therefore follows that Eq. (|2.3.2[) holds for r > 4/5. 

3. The Polyak Weighted Averaging Procedure 

3.1. Preliminaries. Consider the RM type SDE 

t t 
^ = ^ + jH.MdK. + jt.Md mn (3.1.1) 



where 

(1) {H t {u), t > 0, it G i? 1 } is a random field described in Section 0; 

(2) {M(t,u), t > 0, it G i? 1 } is a random field such that 

M(u) = (M(t,u)) t > EMUP) 
t 

for each u G i? 1 and M(t,u) = J £ s (u) dm s , where m = (m t )t>o £ M^(P), 

o 

M(-, 0) 0; £(u) = {£t{u))t>o is a predictable process for each u G i? 1 . Denote 
4:= 4(0). 

(3) K = (K t )t>o is a continuous increasing process. 
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Suppose this equation has a unique strong solution z = (z t )t>o on the whole 
time interval [0, oo), such that 

t 

(M(i)) t > Q = ( | £ s (z s ) dm)j e M&(P). 
o *-° 

In Section 1 the conditions were established which guarantee the convergence 

Zt — > 0, as t — > oo P-a.s. (3.1.2) 

In Section 2, assuming (13.1.21) the conditions were stated under which the 
following property of z — (z t )t>o takes place: 
(a) for each 6, < 5 < 8 , < 5 Q < 1 

7 t ,z t — > 0, as t — >■ oo P-a.s. 

where 7 = (7t)t>o is a predictable increasing process with 7 = 1, 7^ = 00 
P-a.s. 

Further, assuming that z = (z t )t>o has property (a) with the process 7 = 

(lt)t>o, equivalent to the process r 2 (L) -1 =(rf (L)^ 1 )^ (i.e., lim rf ^ = 7 -1 , 

< 7 < 00), in Section 2 the conditions were established under which the 
asymptotic expansion 

r t (L) 1 t /2 z t =-^ + R t , (3.1.3) 

p 

where R t — > as t —> 00, holds true. 

Here the objects 7^ L t , are defined as follows: 

t 

r. = «0.*)-«p(//W*. 





where /3 f = —Hj.(0), L t = jT s £ s (0) dm s , (L) is the shifted square characteris- 



t 

tics of L, i.e., (L) t = 1 + (L)f' P , where (L)f' P = JV 2 J 2 s dK s . 



Consider now the following weighted averaging procedure: 

t 

zt= 1 ^ / z s de s (goK), (3.1.4) 
£ t (goK) J 
o 

where g = (gt)t>o is a predictable process, g t > for all t > 0, P-a.s., e t = 

t t oo 

£ t (g o K") = exp (Jg s dK s ), J g s dK s < oo, t > 0, J g s dK s = oo P-a.s. 



The aim of this section is to study the asymptotic properties of the process 
z = (z t )t>o, as t -> oo. 
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First it should be noted that if z t — > as t — > oo P-a.s., then by the Toeplitz 
lemma (see, e.g., [2S]) it immediately follows that 

Zt — > 0, as t — > oo, P — a.s. 

In subsection 13.21 we establish asymptotic distribution of the process z in 

t 

the "linear" case, when H t (u) = —/3tit, M(t,u) = M(t) = J £ s dm s , with 

o 

deterministic g,(3,l and K, and d(m) t = dK t . 

The general case, i.e., when the process z in (13.1.41) is the strong solution of 
SDE (13.1.11) . is considered in subsection 13.31 

3.2. Asymptotic properties of z. "Linear" Case. In this subsection we 
consider the "linear" case, when SDE (13.1.11) is of the form 

dzt = -P t z t dK t + i t dm t , z , (3.2.1) 

where K = (K t ) t >o is a deterministic increasing function, (3 = (Pt)t>o an d 

oo 

£ — (£t)t>o are deterministic functions, (3 t > for all t > 0, J (3 s dK s = oo, 

o 

t oo 

/ /3 s dK s < oo, for all £ > and J £\dK s < oo. 
o o 
Define the following objects: 

t t 

r, = bp (/&,«•.), L t = Jr, t , dm „ t>o. 



Under the above conditions we have = oo, r^ (L)^ 1 = oo. 



Indeed, application of the Kronecker lemma (see, e.g., [25]) yields 

t 

1 

rf 



T- 2 (L) t = -2 / T 2 f s dK s -> as t - oo, 



o 



since j £ 2 S dK s < oo. 
o 

Solving equation (13.2.11) . we get 

t 

z t = r; 1 ^z + Jv s £ s dm s j, t>0, (3.2.2) 
o 

From (I3.2.2p and CLT for continuous martingales (see, e.e., [25]) it directly 
follows that 

z t — > 0, as oo, (3.2.3) 

Yt{L); 1/2 z t ^i, as t^oo, (3.2.4) 

where "— >" denotes the convergence in distribution, ^ is a standard normal 
random variable (^ € A^(0, 1)). 
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Let now z = (z t ) be an averized process defined by (13.1.41) with the deter- 

oo t 

ministic function g = (gt)t>o, f 9tdK t = oo, f g s dK s < oo for all t > 0. 

o o 

Denote B t = f T^de,, B t = J (B t - B s ) 2 d(L) s , e t = e t {goK). 
o o 

Proposition 3.2.1. Suppose that (L)oo — °°> (L) ° -Boo = oo, B^ = oo. 
Then 

e t B; l/2 z t -i £, as t -> oo, ( e N(0, 1), (3.2.5) 



Proof. Substituting (I3.2.2P in (13.1.41) and integrating by parts, we get 

t 

+ E- 1 J{B t -B s )dL s 



t 

z B t _! 

z t = 

e t 

o 

Hence 



g-l/2_ _ 

£ t£>t z t — z 



t 

B t /(B t ) 1/2 + {B t )- l/2 j (B t - B s ) dL s = l\ + I 2 . (3.2.6) 



First we will show that 

i] — ► 0, as t — > oo. 

It is easy to check that 

t t s 

B t = J (B t - B s ) 2 d(L) s = 2 J ( J (L) u dB^j dB s . (3.2.7) 
o 

We rewrite (I}) 2 in the form 



o o 



(ji)2 = B 2 (B t )- x = 2 ^o Bs ^ o^ udBu ^ ldBs 



Since Boo = oo, applying the Toeplitz lemma, we obtain 

hWL 1 ) 2 = lim -r- ^ . 

^°°J*(L) u dB u 

CO 

Further, as J (L) u dB u = oo, applying again the Toeplitz lemma we get 
o 

B t jl{L)-^L) u dB u 1 
lim —t = hm — — 7 = lim - — — = (J. 

^°°f*(L) u dB u f (L) u dB u *-oc(L) t 

It remains to show that 

as t-^oo, £eiV(0,l). 



50 N. LAZRIEVA, T. SHARIA AND T. TORONJADZE 

For any sequence t n — > oo as n — > oo we define the sequence of martingales 
as follows: 

M»= f nU ^-B s )dL s ^ 
{ll n {B tn -B s )H{L) s )V* 

Obviously, (M n )i = 1 for each n > 1, and from the CLT for continuous 
martingales we have 



AP(1) =/^(asn^oo, £ G #(0, 1). □ 

It should be noted 
Indeed, by the Toeplitz lemma, 



— — 1/2 

Remark 3.2.1. It should be noted that ^oo-Boo = oo. 



Iim | = lim j^Wfz^ = Um i > 



t t 



= hm I (L) s T; 2 T s ds s < lim - I (L s )Tfde s = 0. 

t^oo 1 t £ t J t^oo £ t J 



since = oo and (L) oo r^ 2 = 0. 

Define now the process e[ a ' := e t (g^ o K) as follows: Let (a; t ) t >o be a 
function, a t > for all t > 0, and lima t = a, < a < oo. We define e^ a ' by 

the relation 

e { t a) = 1 + J a s {3 s (L); l T 2 s dK s . (3.2.8) 
o 

Note that 

(L) t r- 2 4 Q ^^/A = (3.2.9) 
Indeed, it is easily seen that if 

t 



E t (ip) = 1 + J (p s dK Sl then ip t 



o 

Hence, if e t (g^ o K) — e[ a \ then 

and (I5T51) follows. 

It should be also noted that for each (a t )t>o with lim a t = a, 

l im h = l. 

*^l + £al3 a (L) 7 ^dK a 
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Proposition 3.2.2. Let = (zt )t>o be an averized process corresponding 
to the averaging process {see < \3.1.4[ ), i-c, 

t 



t ] = j$J z.deW t > 0. 



Then 

1/2 



(l + J p s (L)- l T 2 s dK)j z[ a) 4^, as t - oo, £ e N(0, 1). 
o 

Proof. By virtue of Proposition 13.2.11 it is sufficient to show that 

. ; * > 2, as t -> oo. (3.2.10) 

(£ W)2 ( ^))-l 

where £ t (a) = / T; 1 de[ a) , B[ a) = }{B\ a) - B^f d(L) s . 



o 

We have 



(1) _(1) 5>) 1 5(a) 

hm — = hm — r-r , \ = — Inn 



t ->oo ( £ («) ) 2 ( 5 («) ) - 1 t-oo £ («) £ («) a t->oo £ («) 

= i Um 2^(J - W .^»)r.-^> ^2 i ? 

a t-oo a t^oo T t J w s 

* 

Applying now relation f!3.2.9|) and Toeplitz lemma, we get 

t t 

hm 1 / (L)„dB<»> = hm 1 / (L> ^cfeW 
1 i j 1 * 7 

o o 

W Maj£ w 1 



= iim — / (L) s r;^f Hf-r s /W, = lim — / a s dT s = a. □ 
o o 

Corollary 3.2.1. Let 7 = (7t)t>o be an increasing process such that 70 = 1, 
7oo = 00 and 

y W^f -1 , 

hm = 7 as i-> 00, 

t^oo 7 t 

where 7 is a constant, < 7 < 00. T/ien 

(1) ll /2 z t ^^ l l 2 i, ast^oo; 

(2) (1 +} la MK,y/*# ) ± as t - 00; 



(3) if ls (3 s = l eventually, then (l+fQ) 1 / 2 ^ -> as t -> oo, £eiV(0, 1). 
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Remark 3.2.2. (1) Let 7 = Oyt)t>o '■= (w)t>o be an increasing process, 70 = 1, 
7oo = 00, c?7 <C gL?T. Then 7 can be represented as the solution of the SDE 
djt = lAtdK t , 70 = 1, with some A = (A t ) t > . 

Assume that Xt — > as t — > 00 and At//3t - ► as £ — > 00. Then 

li m ffi = 2. 



t— iOO 



7t 



Indeed, 



It " (L)t ' 

and integration by parts and application of the Toeplitz lemma yield 



It (L) 



t t 
A 1 f A 

' " d(L) a = 2 - — — / -fd(L), -»• 2 as £ -> 00. 





Thus if we put 7 t = || in the above Corollary 13.2. 1[ then all assertions hold 
true with 

A ~ 1 
it 7 2 , 

(2) Let £ t = afi t , where (3 t is a decreasing function, (3 t — > as £ — > 00, 
c/A = -P' t dK t , ft > 0. 
Then, if 

-> as £ -> 00, 



we have 



hm(L)- i r^ i = 2^ 

t— >oo 



From Proposition 13.2.21 immediately follows 

(1 + K t y/ 2 z { t a) 4 v^af as £ -> 00. 

Remark 3.2.3. Summarizing the above statements, we conclude that: as 
£ — > 00, 

(a) ( e ?W> ^ V^; 

(b) (ei a) yH a) - 

(c) (4 1) ) 1/2 4 1) - v^; 

(d) r t (L) t - 1/2 z t 4 £, 

where £ G iV(0, 1) 
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Example 1. Standard "Linear" Procedure. 

Let (3 t = a(3{l + K t )~\ £ t = aa(l + K t )-\ a(3 > 0, 2a(3 > 1. Then 
r^L)" 1 = + K t ). Hence from <K2M follows 

(1 + K t )^z t ^ £ as t - oc, £ € iV(0, 1). 

y/2ap — 1 

On the other hand, £ t (1) = 1 + / /^(L); 1 dK s = 1 + ^If-i) K ^ and [t 
follows from Proposition 13.2.21 that if we define 

t t 

z? = Hi) f z s dei s\ zt = Y^Y t / z,dK " 
£t 

then 



Hence the rate of convergence is the same, but the asymptotic variance of 
averized procedure z is smaller than of the initial one. 

Example 2. "Linear" Procedure with slowly varying gains. 

Let fa = ap(l + K t )~ r , £ t = aa(l + K t )- r , a/3 > 0, \ < r < 1. Then 



the process 7 = (7t)t>o defined in Remark 13.2.21 is 7$ = + ^t) r , ^7* = 

^(1 + ^) r iffe- Hence A * = Si 1 + K t)~\ X t/Pt -> (Tas t -> 00. From 
Remark 13.2.21 it follows that 

lim 51^ = 2, (3.2.11) 

t-*0O 7j 



and from (13.2.41) we have 



[l + K t ) r '\±aJ£-Z, ast^oo, £ e N(0,1). 

V 



On the other hand, 

t 



= 1+ f p s T 2 s {L): l dK s = 1 + f f3 sl ^M^ d K s = 1 +^ f^Mll dKs _ 

J J Is @ J 1 s 



Hence take into the account (13.2.111) . by the Toeplitz Lemma we have 
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Therefore from Remark 13.2.31 (c) we get 

{1 + K t fl 2 z? as t^oo, £GJV(0,1). 

and 

{l + K t f' 2 z t ^^ as t^oo, £eiV(0,l). 

Note that if a(3 > 2, then the asymptotic variance of z is smaller than of 
the initial one. 

Example 3. Let (3 t = (1 + t)~^+ a ) , where a is a constant, < a < 
l\ = (l + t)-(f+ Q ). Then if we take 7 t = = (1 + t)-^ +Q 0(l + £)i + a = l + t, 
d7* = lt^r t dt, then A t = (1 + t)~\ % = (1 + ^(l + £)i+<* = (1 + t) a ^ -> 
as t — > oo. Therefore, from Remark 13.2.21 (1) follows 

t^oo l+t 

and from Corollary 13.2.11 (1) we have 

(l+t) 1 / 2 ^ y|e, ast^oo, £eiV(0,l). 
If we now define 

4 1} = i + 1 ^(L); 1 ^ 

Q 

= 1+ / AT.S^ds = !+/(! + s^S^^s, 

y 7s y 7s 



then ejp/(l + tf' 2 - a -> and from Corollary EXT](2) we obtain 



(1 + t)3/2-a^(i) ^ ^ &s eGiV (0,l). 

In the last two examples the rate of convergence of the averized procedure 
is higher than of the initial one. 

3.3. Asymptotic properties of z. General case. In this subsection we 
study the asymptotic properties of the averized process z = (z) t >o defined by 
(13.1.41) . where z = (z t )t>o is the strong solution of SDE (13.1.11) . 
In the sequel we will need the following objects: 

A = -/y t '(0), Pt(u) = I » ' n 

(Pt, if u = 0, 

r t = e t (/3 o K) = exp { / P s dK s }, L t = J TJ s dm s , £ t = £ t {0), d(m) t = dK t . 
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Assume that processes K, (3 and £ are deterministic. We rewrite equation 
(13.1.11) in terms of these objects. 

dz t = -(3 t z t dK t + l t dm t + (fit - (3 t {z t ))z t dK t + (£ t (z t ) - £ t )dm t . (3.3.1) 

Further, solving formally the last equation as the linear one w.r.t. z, we get 

t t 

zt = ry 1 r 



z + L t + J TsdR^s) + J T s dR 2 (s) 



(3.3.2) 



where 



t 

Y t = exp (JP* dS 6 
o 

t 

L t = Yd. dm.,, 



dR^t) = (p t - p t (z t ))z t dK t , 
dR 2 {t) = (e t (zt) -i t )dm t . 

Consider now the following averaging procedure: 

t 

z t = \\ z s de s , (3.3.3) 
o 

i 

where the process e t := e t = 1 + f Y^L)' 1 (3 s dK s , i.e., is defined by relation 

o 

(EHD with a t = 1. 

In the sequel it will be assumed that the functions (3, £, K, g satisfy all 
conditions imposed on the corresponding functions in Propositions 13.2.11 and 

Let 7 = (7)t>o be an increasing function such that 7 = 1, 7oo = oo and 
lim Ff ^* = 7 _1 . 

Theorem 3.3.1. Suppose that jfz^ — > as t — ► oo /or all 5, < 5 < Sq, 

< 6q <1. Assume that the following conditions are satisfied: 

(i) there exists 5, < 5 < 5q/2 such that 



DC 



£ t It \Pt\Zt) — fk\dK t < oo, P-a.s.; 



o 



(ii) -^y^ — > as t — ► oo, where N t — J Y s (£ s (z s ) — £ s )dm s 
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Then 

e] /2 z t 4 V2£ as t -> oo, £ G iV(0, 1). 

Proof. Substituting ( 13.3.21) in ( 13. 3. 31) . we obtain 

t 

£t £tJ 
o 

where 

R t = J t J j (LudRiiu)) dB s , 2 = 1,2, 







dB t = TT 1 de 



t = 1 4 ut t . 

Integration of the second term in (13.3.41) by parts results in 



z B, 

z t 



t 

- + - f(B t - B s )dL s + R] + (3.3.5) 
o 

Denoting B t = jl{B t — B s ) 2 d(L) s , we have 

etS ^% = „^«L_ + - + + (3.3.6, 

(B t ) 1/2 (B<) 1/2 (S,) 1 ' 2 



As is seen, the first two terms in the right-hand side of (I3.3.6P coincide with 
those in (13.2.61) . and since by our assumption the conditions of Propositions 
13.2.11 and 13.2.21 are satisfied, taking into the account (I3.2.10p with a = 1 one 
can conclude that it suffices to show that 

e]/ 2 Ri-^0, ast^oo, i = 1,2. (3.3.7) 

Let us investigate the case i — 1. 



1/2 p i = 

e 



^ J (^j r u dR 1 (u)^jdB s = -^ J (^j TvdRilv^jT-Het 

1 1 

t s 

J (^J T^R^Tj^de 1 / 2 . 



o o 



Since e t is an increasing process, Eco = oo, by virtue of the Toeplitz Lemma 
it is sufficient to show that 



t 



A t = — — I ^sdRi(s) — > 0, as t — ► oo, P-a.s. 
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For all 5, < 5 < Sq/2, since \z t \ — > as t — > oo, we have 



Kl < — ^ y r s |/3 s -/3 s (z s )||z s |d^ 

<const(u;)— ^ / T sl ; 5 \f3 s - p s (z s )\dK s 

r t e t ^ 

t 

= const(u;)— ^ / r s£ y 2 £; 1/2 77 5 |/3 s -^(^)l^ 

Now the desirable convergence v4 4 — > as £ — ► oo follows from condition (i) 
and the Kronecker lemma applied to the last term of the previous inequalities. 
Consider now the second term 

t s 

e] ,2 R 2 t = J (^j r u (£ u (z u ) - t u )dm}jT- l de s . (3.3.8) 



o o 



t 

Denoting N t = jT s (£ s (z s ) — £ s )dm s and integrating by parts, from (I3.3.8P 

o 

we get 



e] /2 R 2 t = -Aj f(B t - B s )dN s 
£t o 



Further, for any sequence t n , t n — > oo as n — > oo let us consider a sequence 
of martingales Y™, u G [0, 1] defined as follows: 



Y u=4r2 [ - ( rn )i = — / - s.) 

tn 

Now, if we show that {Y n )\ — > as n — > oo, then from the well-known fact 
that K/ 1 (see, e.g., [25]) we get eJ 2 R\ n -> as n -> oo, and 



Thus we have to show that 



t 

1 

o 



(B t - B 8 yd(N) 8 -> as £ -> oo, P-a.s. 
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t t s 



Using the relation J(B t - B s ) 2 d(N) s = 2j ( / (N) u dB u )dB s , we have to 
o oo 

show: 

t t s 

jJ(Bt~ B s fd{N) s = 2jJ U(N) u dBAr- 1 de,^0 as t^oo (3.3.9) 



Applying the Toeplitz lemma to (13.3.91) it suffices to show that 



— / (N) s dB s ->0 as t -> oo, P-a.s. 



(3.3.10) 



But 



i | (iV) s dS s = iy (JVj.r; 1 ^ = (N) s (L): l dT s (3.3.11) 



(recall that de s = T^L)" 1 (3 s dK s ). 

Applying again the Toeplitz lemma to ( 13.3.1 11) we can see that ( 13.3. 10p 
follows from condition (ii). □ 

Corollary 3.3.1. Let H t {u) = —f3 t u + v t {u), where for each t G [0, oo), 
\^-v t \ ^ asu^O, P-a.s. 

Assume that the following condition is satisfied: 

(f) there exists 8, < 8 < 8q such that 

oo 

I e] /2 ^ 25 \v t \dK t < oo. 
o 

Then condition (i) of Theorem VS. 3.1\ is satisfied. 
Proof. Since %{v) - (3 t \ = |^|, we have for 8, < 8 < f , 



e] /2 r S \(3s{zt)-f3t\dKt< I 



-V2 -<s 



v t {z t ) 



\z t \dK t 



< const (u) j eTlt™ 



v t {z t ) 



dK+ 



oo 

< const(c;) J e] /2 ^ 2S \v t \dK t < oo. 



Corollary 3.3.2. Let £t(u) — h — Vt(u), where for each t 6 [0, oo) 
u t (u) 



u 



<*>t 



as u — > 0, P-a.s., 



Assume that the condition below is satisfied: 



□ 
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(ii') there exists 5, < 5 < 5q such that 
t 

— — / Y 2 ^~ s \u s \ 2 ds — ► 0, as t — > oo, (P-a.s.). 

\ L )t J 
o 

Then condition (ii) of Theorem \3.3.1\ is satisfied. 
Proof. For all 5, < 5 < 5q we have 
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(N) t = / T 2 s (£ s (z s ) - Q 2 dK s 



2 ( £s\%s) @>s\ 2 2 



z z s dK s 



z 

< const(c<j) j T 2 j~ 5 \uj s \ 2 ds, 



since jfz 2 — > as t — ► oo, P-a.s., and 



as £ — > oo. 



Finally, we can conclude that the assertion of Theorem 13.3.11 is valid if we 
replace conditions (i), (ii) by (f), (ii'), respectively. □ 

Example 4. Averaging Procedure for RM Stochastic Approximation Algo- 
rithm with Slowly Varying Gain. 

Let H t {u) = ( 1+ ^)r R(u) , where ~ < r < 1, _R(m) = —/3m + where 
f (u) = 0(u 2 ) as m — > 0, £ t = (i+j^r ) °t is deterministic, of — > a 2 as £ — > oo, 
= (iQ) is a continuous increasing function with i^oo = oo. That is, we 
consider the following SDE: 

t t 



z t 



dmt 



with d(m)t = dK t . 

If r > |, then according to Example 6 of Section 2 



[i + K t y/ 2 z t 



d lao- 



C, as t-^oo, feiV(0,l), 



and moreover, for all 5, < 5 < y, 5o = 2 — i 

(1 + K t ) s z t ^0 as t^oo (P-a.s.), 
Thus for the convergence 

{\ + K t f'H t ^ J^i as t^oo, eeiV(0,l), 
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it is sufficient to verify condition (i') of Theorem 13.3.11 since condition (ii) is 
satisfied trivially. 

In this example the object Vt(u) defined in Corollary 13.3. II is 

, . cuv(u) 
vAu) 



(1 + K t )' 



and for condition {%') of Corollary 13.3. II to be satisfied it is sufficient to require 
the following: there exists S, < S < So, So = 2 — - such that 

t 

J(l + K t f' 2 {l + K t )- 25 (1 + K t )- r dK t < oo 
o 

or equivalently, there exists 5, < S < So, So = r — \ such that r(l + S) — ~ > 1. 
It is not difficult to check that if r > I such a S does exist. 
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